-- Logs begin at Fri 2022-07-01 18:44:19 UTC, end at Fri 2022-07-01 20:07:34 UTC. -- Jul 01 19:23:59.993002 dv-cinder-831247-20-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 01 19:24:00.003650 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 19:24:00 2022] *** Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: nodename: dv-cinder-831247-20-iscsi Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: machine: x86_64 Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: clock source: unix Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: pcre jit disabled Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: detected number of CPU cores: 4 Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: current working directory: / Jul 01 19:24:00.005681 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: detected binary path: /usr/bin/uwsgi-core Jul 01 19:24:00.006297 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: your processes number limit is 47680 Jul 01 19:24:00.006297 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: your memory page size is 4096 bytes Jul 01 19:24:00.006297 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: detected max file descriptor number: 2048 Jul 01 19:24:00.006297 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: lock engine: pthread robust mutexes Jul 01 19:24:00.006297 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: thunder lock: enabled Jul 01 19:24:00.006297 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 01 19:24:00.006297 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 19:24:00.054366 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: Python main interpreter initialized at 0x55769bb6d9c0 Jul 01 19:24:00.054366 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: python threads support enabled Jul 01 19:24:00.054366 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: your server socket listen backlog is limited to 100 connections Jul 01 19:24:00.054366 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: your mercy for graceful operations on workers is 90 seconds Jul 01 19:24:00.054748 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 19:24:00.054748 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: *** Operational MODE: preforking *** Jul 01 19:24:00.055082 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: *** uWSGI is running in multiple interpreter mode *** Jul 01 19:24:00.055082 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: spawned uWSGI master process (pid: 80233) Jul 01 19:24:00.055278 dv-cinder-831247-20-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 01 19:24:00.055957 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: spawned uWSGI worker 1 (pid: 80243, cores: 1) Jul 01 19:24:00.056191 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: spawned uWSGI worker 2 (pid: 80244, cores: 1) Jul 01 19:24:00.056336 dv-cinder-831247-20-iscsi devstack@keystone.service[80233]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 19:24:05.405914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:24:05.405914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: from cryptography.utils import int_from_bytes Jul 01 19:24:05.406749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:24:05.406749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: from cryptography.utils import int_from_bytes Jul 01 19:24:05.407155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:24:05.407155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: from cryptography.utils import int_from_bytes Jul 01 19:24:05.407262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:24:05.407262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: from cryptography.utils import int_from_bytes Jul 01 19:24:05.454022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:24:05.454210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:24:05.454291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:24:05.454371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] command line args: [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:24:05.454437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:24:05.454653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] command line args: [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:24:05.454783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:24:05.454783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ================================================================================ {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:24:05.454917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:24:05.455049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] admin_token = **** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.455193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ================================================================================ {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:24:05.455285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] config_dir = [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.455366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] admin_token = **** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.455442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.455526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] config_dir = [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.455596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] config_source = [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.455661 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.455741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] debug = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.455820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] config_source = [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] debug = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.456880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] list_limit = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] list_limit = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] log_config_append = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] log_config_append = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] log_dir = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] log_file = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] log_dir = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.457883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] log_file = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.458963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.459926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.460986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.461167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.461291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.461648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.461772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.461860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] publish_errors = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.461941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] publish_errors = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.462057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.462204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.462629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.462750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.462842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.462915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] standard_threads = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] standard_threads = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.463934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464060 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464177 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] use_journal = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] use_journal = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] use_json = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] use_stderr = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] use_json = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] use_syslog = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] use_stderr = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464866 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] use_syslog = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.464987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.465145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:24:05.465269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.465361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.465442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.465588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.465673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.465823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.465912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.466087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.466172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.466321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.466404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.466558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.466642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.466784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.466867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.467964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468191 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.468992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.469121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.469210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.469363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.469445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.469583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.469662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.469810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.469900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.470070 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.470207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.470324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.470510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.470688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.470767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.470945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471727 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.471946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.472104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.472180 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.472342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.472425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.472566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.472643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.472788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.472865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.473941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.474946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.475994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.476073 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.476224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.476327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.476449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.476558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.476679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.476778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.476904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477671 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.477904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.478966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.479993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.480145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.480271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.480354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.480415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.480585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.480665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.480812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.480957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.481035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.481093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.481286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.481409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.481519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.481598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.481765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.481851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.482981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.483971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.484113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.484191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.484340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.484424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.484565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.484642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.484795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.484872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.485962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.486940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.487985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.488063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.488219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.488295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.488443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.488520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.488689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.488767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.488937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] auth.external = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] auth.external = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.489935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.490146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.490238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.490381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.490459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] auth.password = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.490606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] auth.token = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.490686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] auth.password = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.490834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] auth.token = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.490919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.491984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] credential.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] credential.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.492981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.493133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.493212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.493360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.493439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.493593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.493686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.493819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.493899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.494074 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.494154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.494327 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.494417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.494555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.494634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.494795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.494873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.495043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.495131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.495300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.495417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.495602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.495681 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.495836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.495923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.496082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.496161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.496310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] federation.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.496388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.496537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.496624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] federation.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.496773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.496853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497230 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.497938 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.498972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.499120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.499200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.499357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.499433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.499582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.499662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.499808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.499886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.500955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.501941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.502123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.502205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.502362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.502441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.502598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.502677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.502840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.502927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.503076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.503155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.503323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.503401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.503558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.503638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.503785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.503864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.504924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.505926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.506116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.506196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.506361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.506442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.506592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.506671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.506833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.506912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.507985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.508977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.509135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.509214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.509357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.509436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.509578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.509657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.509802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.509881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.510981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.511070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.511208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.511287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.511444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.511523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.511700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.511790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.511939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.512939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.513086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.513174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.513311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.513396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.513537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.513616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.513758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.513848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.514954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515711 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.515948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.516086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.516165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.516311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.516390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.516538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.516624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.516773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.516852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.517917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.518919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] resource.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] resource.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.519990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.520077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.520216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.520295 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.520453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.520530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.520698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.520786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.520925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.521918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] role.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.522094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] role.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.522187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] role.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.522340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] role.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.522420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.522568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.522646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.522813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.522900 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.523056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.523135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.523298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.523377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.523534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.523613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.523770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.523849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.524943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.525024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.525179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.525264 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.525416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.525495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.525658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.525801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.526059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.526143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.526305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.526385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.526549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.526670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.526837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.526917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.527078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.527157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.527305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.527386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.527546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.527625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.527787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.527865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.528924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.529968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.530115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.530194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.530341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.530418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] token.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.530568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] token.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.530800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.530877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.531960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532193 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.532967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.533115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.533193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.533346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.533431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.533584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.533661 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.533804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.533882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.534059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.534152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.534304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.534382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.534589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.connection = **** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.534675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.534827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.534907 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.connection = **** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.535980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.536967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.537124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.537203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.537362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.537442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.537597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.537710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.537843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.537924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.538961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80243) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:24:05.539032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:24:05.539195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:24:05.569127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.569348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.569434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.569572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.569656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.569842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.578197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.578311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.606482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.606632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.606795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.606982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.750837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.751504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.799224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.799419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.799698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.799929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.862836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.863945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.864023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.864085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.888634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.888855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.888971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.889104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.889243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.889366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.889488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.889618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.889747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.889872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.890074 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.890202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.890327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.890469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.900829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.901111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.913568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.913776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.913923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.914940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.915070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80243) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 19:24:05.932134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.932347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 19:24:05.932674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.932805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.932924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 19:24:05.933004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 19:24:05.933116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.933204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.933396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 19:24:05.933539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.933612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.933687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.933884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.934034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.934119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.934386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.944651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.944921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.945186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.945310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.945437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.945527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.945750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.946047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.953742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:05.954278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:05.957048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:05.957324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.957481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:05.957573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.957754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.957861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.958072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.958198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.958312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.958399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.958590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.958684 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.958865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.958991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.959072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.959151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.959344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.959439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.959627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.959755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.959836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.960125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.986582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.986708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.988183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:05.988310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:05.988432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.988546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.993755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:05.994046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:05.994422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.001513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.001684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.001813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.001974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.002144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.006529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.006807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.007080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.007351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.007610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.007873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.008137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.008389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.009428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.009708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.014260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.014546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.014828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.015107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.015365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.015635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.015904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.016167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.026965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.027234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.031799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.034714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.034997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.035395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.035675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.039636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.040858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.043336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.043944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.044482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.048098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.048384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.048661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.048830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.048962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.049226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.049494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.052528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.056119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.056421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.056704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.056996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.057272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.057567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.068668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.068945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.069199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.069448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.076709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.076993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.077254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.077377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.077594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.079079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.079345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.082633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.082908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.083176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.083440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.083710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.085364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.087088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.087709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.090958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.091235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.091505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.091783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.092075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.097282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.097557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.097831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.098128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.098397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.100064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.100354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.105364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.105644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.105924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.106224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.106503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.108203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.108496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.118314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.121554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.124849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.126430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.126620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.128183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.128460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.128726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.129671 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.132990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.134729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.135999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.136396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.136676 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.136965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.137635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.140842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.141122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.141499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.141763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.144270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.145864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.149111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.149391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.149779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.150083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.150889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.151168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.151443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.159200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.159326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80243) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.159472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.159620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.159718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.159843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.159970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.160252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.160611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.160894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.161158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.161428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.161694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.161932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.162240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.162583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.162859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80243) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.167626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 19:24:06.167898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.168145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.168429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.168695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.169069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.169341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.169607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.169884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.170175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.170444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.170703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.170962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.171196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 19:24:06.200679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55769bb6d9c0 pid: 80243 (default app) Jul 01 19:24:06.204064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a6b2c-377b-4731-bd1b-d7eb06f1e498 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:06.204351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a6b2c-377b-4731-bd1b-d7eb06f1e498 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:06.204622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a6b2c-377b-4731-bd1b-d7eb06f1e498 None None] PATH_INFO: `/v3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:06.208797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Fri Jul 1 19:24:06 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:06.208985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55769bb6d9c0 pid: 80244 (default app) Jul 01 19:24:13.909445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec74f-eb97-44da-b5cb-569a4d4bfc51 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:13.910420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec74f-eb97-44da-b5cb-569a4d4bfc51 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:13.910420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ec74f-eb97-44da-b5cb-569a4d4bfc51 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:13.912650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:13.924896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:13.925637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:13.925782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:13.997540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: INFO dbcounter [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] Registered counter for database keystone Jul 01 19:24:14.021979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG oslo_db.sqlalchemy.engines [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:24:14.029648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writer thread running {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:24:14.209761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG passlib.handlers.bcrypt [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80244) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 01 19:24:14.210136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG passlib.handlers.bcrypt [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80244) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 01 19:24:14.265647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:14.267277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:14.412590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1/3] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 01 19:24:14.643591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec74f-eb97-44da-b5cb-569a4d4bfc51 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:14.719949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: INFO dbcounter [None req-d86ec74f-eb97-44da-b5cb-569a4d4bfc51 None None] Registered counter for database keystone Jul 01 19:24:14.743145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG oslo_db.sqlalchemy.engines [None req-d86ec74f-eb97-44da-b5cb-569a4d4bfc51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80243) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:24:14.750556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writer thread running {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:24:14.869496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ec74f-eb97-44da-b5cb-569a4d4bfc51 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:14.875091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cd0b8-84b3-4e3d-9a98-28a5c3a20171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:14.875753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cd0b8-84b3-4e3d-9a98-28a5c3a20171 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:14.876050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cd0b8-84b3-4e3d-9a98-28a5c3a20171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:14.876316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cd0b8-84b3-4e3d-9a98-28a5c3a20171 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:14.885463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cd0b8-84b3-4e3d-9a98-28a5c3a20171 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:14.936487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b84cd0b8-84b3-4e3d-9a98-28a5c3a20171 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 01 19:24:14.937073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cd0b8-84b3-4e3d-9a98-28a5c3a20171 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:14.947089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1324 bytes} [Fri Jul 1 19:24:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:24:14.957167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:14.981458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b8efeb-4b6c-42e0-9a67-63ab928728c2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:14.987253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1cf59-3340-46e3-b6e1-34ee69029798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:14.988408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1cf59-3340-46e3-b6e1-34ee69029798 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:14.988692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1cf59-3340-46e3-b6e1-34ee69029798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:14.988968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1cf59-3340-46e3-b6e1-34ee69029798 admin admin] PATH_INFO: `/v3/projects/2c274d3083ff496a9f0346d090423253` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:14.993167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1cf59-3340-46e3-b6e1-34ee69029798 admin admin] RBAC: Authorizing `identity:get_project(project_id=2c274d3083ff496a9f0346d090423253)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:15.044136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6fd1cf59-3340-46e3-b6e1-34ee69029798 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 01 19:24:15.044479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1cf59-3340-46e3-b6e1-34ee69029798 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:15.049105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 2/5] 10.222.0.61 () {56 vars in 1207 bytes} [Fri Jul 1 19:24:14 2022] GET /identity/v3/projects/2c274d3083ff496a9f0346d090423253 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:17.059434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6378f-5bbd-45d7-ac36-82dc0bdb8e80 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:17.059992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6378f-5bbd-45d7-ac36-82dc0bdb8e80 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:17.059992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6378f-5bbd-45d7-ac36-82dc0bdb8e80 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:17.066111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 4/6] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:17.074558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542de29-1c19-4688-b5a4-8fc9d898aa5e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:17.074981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542de29-1c19-4688-b5a4-8fc9d898aa5e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:17.075071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542de29-1c19-4688-b5a4-8fc9d898aa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:17.095760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1542de29-1c19-4688-b5a4-8fc9d898aa5e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:17.097312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1542de29-1c19-4688-b5a4-8fc9d898aa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:17.106981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 3/7] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 01 19:24:17.129803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6378f-5bbd-45d7-ac36-82dc0bdb8e80 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:17.145467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6378f-5bbd-45d7-ac36-82dc0bdb8e80 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:17.151254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a532a60-9c55-4591-b19c-4d70acf2ce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:17.151925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532a60-9c55-4591-b19c-4d70acf2ce88 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:17.152217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532a60-9c55-4591-b19c-4d70acf2ce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:17.152496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532a60-9c55-4591-b19c-4d70acf2ce88 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:17.161271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a532a60-9c55-4591-b19c-4d70acf2ce88 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:17.163097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a532a60-9c55-4591-b19c-4d70acf2ce88 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:17.172212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 5/8] 10.222.0.61 () {58 vars in 1324 bytes} [Fri Jul 1 19:24:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:24:17.180682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542de29-1c19-4688-b5a4-8fc9d898aa5e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:17.195728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542de29-1c19-4688-b5a4-8fc9d898aa5e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:17.201278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5393f97-b3cb-45cd-95ee-7694c57dad8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:17.202195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393f97-b3cb-45cd-95ee-7694c57dad8e admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:17.202483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393f97-b3cb-45cd-95ee-7694c57dad8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:17.202757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5393f97-b3cb-45cd-95ee-7694c57dad8e admin admin] PATH_INFO: `/v3/users/6b9038df7e244837aceca33ded6cf0a5` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:17.204155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5393f97-b3cb-45cd-95ee-7694c57dad8e admin admin] RBAC: Authorizing `identity:get_user(user_id=6b9038df7e244837aceca33ded6cf0a5)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:17.206035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5393f97-b3cb-45cd-95ee-7694c57dad8e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:17.207607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 4/9] 10.222.0.61 () {56 vars in 1198 bytes} [Fri Jul 1 19:24:17 2022] GET /identity/v3/users/6b9038df7e244837aceca33ded6cf0a5 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:19.277776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201b198-8e81-405e-af22-ca74a3a7a518 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.278342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201b198-8e81-405e-af22-ca74a3a7a518 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.278342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201b198-8e81-405e-af22-ca74a3a7a518 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:19.279726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:19.285041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ab1ab-94ad-41ba-8420-698db6d860b1 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.285487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ab1ab-94ad-41ba-8420-698db6d860b1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.285574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ab1ab-94ad-41ba-8420-698db6d860b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:19.302731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0b7ab1ab-94ad-41ba-8420-698db6d860b1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:19.303889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0b7ab1ab-94ad-41ba-8420-698db6d860b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:19.313292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57cfe1-6cc3-4101-b58d-1c7ca1d8445d None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.313514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57cfe1-6cc3-4101-b58d-1c7ca1d8445d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.313790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57cfe1-6cc3-4101-b58d-1c7ca1d8445d None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:19.315194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 7/11] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:19.320260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.320542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.320795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:19.360896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG passlib.handlers.bcrypt [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80243) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 01 19:24:19.361303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG passlib.handlers.bcrypt [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80243) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 01 19:24:19.388654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 5/12] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:19.406219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:19.407805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:19.411881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ab1ab-94ad-41ba-8420-698db6d860b1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:19.436234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:19.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 8/13] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:19.518027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ab1ab-94ad-41ba-8420-698db6d860b1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:19.533134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:19.551983 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23035880-13b8-484b-8c03-0cdf1fc80bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:19.552802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23035880-13b8-484b-8c03-0cdf1fc80bdd None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.553060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23035880-13b8-484b-8c03-0cdf1fc80bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.553357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23035880-13b8-484b-8c03-0cdf1fc80bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:19.564927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23035880-13b8-484b-8c03-0cdf1fc80bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-23035880-13b8-484b-8c03-0cdf1fc80bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:19.576336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:19.577269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:19.578115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 6/14] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:24:19.583636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23035880-13b8-484b-8c03-0cdf1fc80bdd None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:19.636824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c6228-bac7-4d32-9f59-60d36d3767a5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:19.639384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:19.668976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:19.674595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ea435-b047-40f0-8405-4fefb34b65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:19.675519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea435-b047-40f0-8405-4fefb34b65ee None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.675812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea435-b047-40f0-8405-4fefb34b65ee None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.676117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ea435-b047-40f0-8405-4fefb34b65ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:19.688557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23035880-13b8-484b-8c03-0cdf1fc80bdd None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:19.721795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:19.722495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.722758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.723015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:19.723775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:19.724065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:19.725598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:19.737569 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 7/15] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:19.741478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ea435-b047-40f0-8405-4fefb34b65ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:19.743065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ea435-b047-40f0-8405-4fefb34b65ee None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:19.743180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:19.840382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b9c12-ba58-4598-865c-136eafb615bd None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:19.842620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 9/16] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:24:19.848256 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ea435-b047-40f0-8405-4fefb34b65ee None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:19.851041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:19.873999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82d1be-e4fa-4a1c-ad73-bbf6c3d51b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:19.874888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d1be-e4fa-4a1c-ad73-bbf6c3d51b1d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.875168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d1be-e4fa-4a1c-ad73-bbf6c3d51b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.875438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82d1be-e4fa-4a1c-ad73-bbf6c3d51b1d None admin] PATH_INFO: `/v3/users/6b9038df7e244837aceca33ded6cf0a5` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:19.876644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82d1be-e4fa-4a1c-ad73-bbf6c3d51b1d None admin] RBAC: Authorizing `identity:get_user(user_id=6b9038df7e244837aceca33ded6cf0a5)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:19.878131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff82d1be-e4fa-4a1c-ad73-bbf6c3d51b1d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:19.879883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 8/17] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:19 2022] GET /identity/v3/users/6b9038df7e244837aceca33ded6cf0a5 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:19.885388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82d1be-e4fa-4a1c-ad73-bbf6c3d51b1d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:19.899419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:19.951005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ea435-b047-40f0-8405-4fefb34b65ee None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:19.987959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff82d1be-e4fa-4a1c-ad73-bbf6c3d51b1d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:19.993853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:19.994698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:19.995029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:19.995318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:20.014089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:20.015570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:20.022909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745768c-63ad-4adf-81a0-c122a467f0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:20.023716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745768c-63ad-4adf-81a0-c122a467f0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:20.023997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745768c-63ad-4adf-81a0-c122a467f0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:20.024275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745768c-63ad-4adf-81a0-c122a467f0e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:20.025453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745768c-63ad-4adf-81a0-c122a467f0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:20.027200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745768c-63ad-4adf-81a0-c122a467f0e2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:20.028678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 9/18] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:20.034550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745768c-63ad-4adf-81a0-c122a467f0e2 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:24:20.035892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:20.036713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:20.037499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:24:20.037499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:24:20.037499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:24:20.037499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:20.037499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 10/19] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:20.042914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:20.099799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:20.117954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:20.136884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745768c-63ad-4adf-81a0-c122a467f0e2 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:20.144262 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c9955-80e6-4737-bf48-07c31b70c859 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:20.170807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2eb99-0810-40b4-bae7-b547cbae416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:20.171456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2eb99-0810-40b4-bae7-b547cbae416c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:20.171734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2eb99-0810-40b4-bae7-b547cbae416c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:20.172001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2eb99-0810-40b4-bae7-b547cbae416c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:20.172827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2eb99-0810-40b4-bae7-b547cbae416c None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.domain.id=default, user.id=6b9038df7e244837aceca33ded6cf0a5) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:20.173131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2eb99-0810-40b4-bae7-b547cbae416c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:20.174609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2eb99-0810-40b4-bae7-b547cbae416c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:20.177543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18610e9-f04c-4d6d-a6fd-d108012f4239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:20.178245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18610e9-f04c-4d6d-a6fd-d108012f4239 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:20.178536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18610e9-f04c-4d6d-a6fd-d108012f4239 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:20.178813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18610e9-f04c-4d6d-a6fd-d108012f4239 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:20.179552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18610e9-f04c-4d6d-a6fd-d108012f4239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:20.179864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18610e9-f04c-4d6d-a6fd-d108012f4239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:20.181175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 10/20] 10.222.0.61 () {56 vars in 1322 bytes} [Fri Jul 1 19:24:20 2022] GET /identity/v3/role_assignments?user.id=6b9038df7e244837aceca33ded6cf0a5&scope.domain.id=default&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:20.181268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18610e9-f04c-4d6d-a6fd-d108012f4239 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:20.200691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 11/21] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:22.517623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170a05-838b-42cd-a4eb-437ce6f81d46 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:22.518199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170a05-838b-42cd-a4eb-437ce6f81d46 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:22.518199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e170a05-838b-42cd-a4eb-437ce6f81d46 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:22.519835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 11/22] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:22.525008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdad83-83dc-486a-b2d4-7ee5dca702c8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:22.525843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdad83-83dc-486a-b2d4-7ee5dca702c8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:22.526399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdad83-83dc-486a-b2d4-7ee5dca702c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:22.539496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542ac3-801b-4e25-bb07-7b245c2635bc None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:22.540105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542ac3-801b-4e25-bb07-7b245c2635bc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:22.540593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2542ac3-801b-4e25-bb07-7b245c2635bc None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:22.542644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 12/23] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:22.547647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2840db-552f-4ffa-bad4-3b7d5f06412d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:22.548178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2840db-552f-4ffa-bad4-3b7d5f06412d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:22.548644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2840db-552f-4ffa-bad4-3b7d5f06412d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:22.575900 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6bfdad83-83dc-486a-b2d4-7ee5dca702c8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:22.583440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6bfdad83-83dc-486a-b2d4-7ee5dca702c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:22.583952 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-fd2840db-552f-4ffa-bad4-3b7d5f06412d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:22.585354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fd2840db-552f-4ffa-bad4-3b7d5f06412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:22.714527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 12/24] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:22.716307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c34ad-b29e-4a58-9834-32b0a95adc72 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:22.716905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c34ad-b29e-4a58-9834-32b0a95adc72 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:22.717363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c34ad-b29e-4a58-9834-32b0a95adc72 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:22.719177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 13/25] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:22.725152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df2744-6c94-4df3-b387-bebac636ebdd None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:22.725593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df2744-6c94-4df3-b387-bebac636ebdd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:22.726043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df2744-6c94-4df3-b387-bebac636ebdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:22.734771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 13/26] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:22.743894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2840db-552f-4ffa-bad4-3b7d5f06412d None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:22.768568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d4df2744-6c94-4df3-b387-bebac636ebdd None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:22.769700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d4df2744-6c94-4df3-b387-bebac636ebdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:22.840986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:22.878741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:22.894445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 14/27] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:22.895303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df2744-6c94-4df3-b387-bebac636ebdd None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:22.915364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2840db-552f-4ffa-bad4-3b7d5f06412d None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:22.976549 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9e24-900e-4fd5-bad8-8f72424450d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:22.977598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9e24-900e-4fd5-bad8-8f72424450d8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:22.978072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9e24-900e-4fd5-bad8-8f72424450d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:22.978663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9e24-900e-4fd5-bad8-8f72424450d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.001749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb9e24-900e-4fd5-bad8-8f72424450d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-fcbb9e24-900e-4fd5-bad8-8f72424450d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:23.010590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:23.011510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:23.012235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:23.014820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 14/28] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:24:23.016183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9e24-900e-4fd5-bad8-8f72424450d8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:23.107949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df2744-6c94-4df3-b387-bebac636ebdd None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:23.127089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9e24-900e-4fd5-bad8-8f72424450d8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:23.163437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68518655-a738-4b41-b474-90fe42a7af9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:23.164466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68518655-a738-4b41-b474-90fe42a7af9a None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.164941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68518655-a738-4b41-b474-90fe42a7af9a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.165421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68518655-a738-4b41-b474-90fe42a7af9a None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.166400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68518655-a738-4b41-b474-90fe42a7af9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:23.168088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68518655-a738-4b41-b474-90fe42a7af9a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:23.170733 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:23.171615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:23.172429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.172720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.173022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.193710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:23.195654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:24:23.238335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:23.239213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:23.240459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:24:23.240459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:24:23.240459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:24:23.240459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:23.240459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 15/29] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:23.240459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:23.277388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:23.328767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 15/30] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jul 1 19:24:23 2022] POST /identity/v3/roles => generated 219 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:23.335594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68518655-a738-4b41-b474-90fe42a7af9a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:23.358010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6bd80-4da0-4838-88fb-f264f6b738ca None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:23.386499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39ee25-f0cd-491d-bcbd-083f79c2e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:23.387355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ee25-f0cd-491d-bcbd-083f79c2e1ee None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.387645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ee25-f0cd-491d-bcbd-083f79c2e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.392126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39ee25-f0cd-491d-bcbd-083f79c2e1ee None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.392126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39ee25-f0cd-491d-bcbd-083f79c2e1ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:23.392126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39ee25-f0cd-491d-bcbd-083f79c2e1ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:23.392126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39ee25-f0cd-491d-bcbd-083f79c2e1ee None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:23.404182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 16/31] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:23.406964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa14b7-d519-4176-9964-aa0ba1ee4a3c None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.406964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa14b7-d519-4176-9964-aa0ba1ee4a3c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.406964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa14b7-d519-4176-9964-aa0ba1ee4a3c None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.412161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 17/32] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:23.413032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa14b7-d519-4176-9964-aa0ba1ee4a3c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:23.556260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:23.557698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68518655-a738-4b41-b474-90fe42a7af9a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:23.576966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa14b7-d519-4176-9964-aa0ba1ee4a3c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:23.605891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:23.607042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.607524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.608004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.609035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:23.609641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:23.611306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:23.618267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013a1eb-81d5-4130-aa43-197227122010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:23.619410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013a1eb-81d5-4130-aa43-197227122010 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.619889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013a1eb-81d5-4130-aa43-197227122010 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.620360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013a1eb-81d5-4130-aa43-197227122010 None admin] PATH_INFO: `/v3/users/6b9038df7e244837aceca33ded6cf0a5` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.622154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013a1eb-81d5-4130-aa43-197227122010 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9038df7e244837aceca33ded6cf0a5)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:23.623791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013a1eb-81d5-4130-aa43-197227122010 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:23.625647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 18/33] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:23 2022] GET /identity/v3/users/6b9038df7e244837aceca33ded6cf0a5 => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:23.627081 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ab1d9-41fc-4083-91c7-f8c8d91caa7b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.627555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ab1d9-41fc-4083-91c7-f8c8d91caa7b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.628122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ab1d9-41fc-4083-91c7-f8c8d91caa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.639160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 16/34] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:23.640204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:23.647049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-700ab1d9-41fc-4083-91c7-f8c8d91caa7b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:23.648586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-700ab1d9-41fc-4083-91c7-f8c8d91caa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:23.703213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:23.738109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 19/35] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:23.739720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ab1d9-41fc-4083-91c7-f8c8d91caa7b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:23.775992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53135f8-a642-41e3-9c26-53d064d05413 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:23.823716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9287-e11d-4fe9-84c9-710e5200bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:23.824539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9287-e11d-4fe9-84c9-710e5200bd50 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.824823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9287-e11d-4fe9-84c9-710e5200bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.825518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9287-e11d-4fe9-84c9-710e5200bd50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.831499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe9287-e11d-4fe9-84c9-710e5200bd50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:23.833199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe9287-e11d-4fe9-84c9-710e5200bd50 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:23.840928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 17/36] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:23.841766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9287-e11d-4fe9-84c9-710e5200bd50 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:23.846755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:23.870024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ab1d9-41fc-4083-91c7-f8c8d91caa7b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:23.916246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbbb91-6116-4261-87bf-0f91e81b00ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:23.918496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbb91-6116-4261-87bf-0f91e81b00ab None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:23.919095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbb91-6116-4261-87bf-0f91e81b00ab None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:23.919557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbbb91-6116-4261-87bf-0f91e81b00ab None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:23.920475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbbb91-6116-4261-87bf-0f91e81b00ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:23.923235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbbb91-6116-4261-87bf-0f91e81b00ab None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:23.960489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9287-e11d-4fe9-84c9-710e5200bd50 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:23.987012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:24.000776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09c4d0-2915-438e-8bb3-2a19c134b534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:24.001875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09c4d0-2915-438e-8bb3-2a19c134b534 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.002390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09c4d0-2915-438e-8bb3-2a19c134b534 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.002850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09c4d0-2915-438e-8bb3-2a19c134b534 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.003828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09c4d0-2915-438e-8bb3-2a19c134b534 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:24.005553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09c4d0-2915-438e-8bb3-2a19c134b534 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:24.021629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jul 1 19:24:23 2022] POST /identity/v3/roles => generated 225 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:24.022953 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09c4d0-2915-438e-8bb3-2a19c134b534 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:24.067482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 20/38] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:24:23 2022] POST /identity/v3/projects => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:24.069067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255355a6-5b20-4430-a4bc-01be3f7aa435 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.069467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255355a6-5b20-4430-a4bc-01be3f7aa435 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.069762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255355a6-5b20-4430-a4bc-01be3f7aa435 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.071670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 21/39] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:24.077911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb896e-e08b-4702-b708-78293bddc3c5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.078389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb896e-e08b-4702-b708-78293bddc3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.079375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb896e-e08b-4702-b708-78293bddc3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.102305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-9ecb896e-e08b-4702-b708-78293bddc3c5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:24.104218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9ecb896e-e08b-4702-b708-78293bddc3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:24.162505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09c4d0-2915-438e-8bb3-2a19c134b534 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:24.189025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 22/40] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:24.198194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc27b5-3129-4a71-aaa4-9ee030d69e52 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.198601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc27b5-3129-4a71-aaa4-9ee030d69e52 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.198984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc27b5-3129-4a71-aaa4-9ee030d69e52 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.200988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 23/41] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:24.206696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf291-ec40-4c68-9277-61b843b94510 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.206864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf291-ec40-4c68-9277-61b843b94510 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.207211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaf291-ec40-4c68-9277-61b843b94510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.209201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419b7c3-627b-4db3-89fb-6af6160e1f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:24.210386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b7c3-627b-4db3-89fb-6af6160e1f5c None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.210894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b7c3-627b-4db3-89fb-6af6160e1f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.211322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419b7c3-627b-4db3-89fb-6af6160e1f5c None admin] PATH_INFO: `/v3/domains/default/users/6b9038df7e244837aceca33ded6cf0a5/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.214288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419b7c3-627b-4db3-89fb-6af6160e1f5c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6b9038df7e244837aceca33ded6cf0a5, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:24.215978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419b7c3-627b-4db3-89fb-6af6160e1f5c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:24.235609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2faaf291-ec40-4c68-9277-61b843b94510 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:24.236914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2faaf291-ec40-4c68-9277-61b843b94510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:24.243786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 19/42] 10.222.0.61 () {58 vars in 1361 bytes} [Fri Jul 1 19:24:24 2022] PUT /identity/v3/domains/default/users/6b9038df7e244837aceca33ded6cf0a5/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:24.245329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419b7c3-627b-4db3-89fb-6af6160e1f5c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:24.308507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:24.332528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:24.344790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 24/43] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:24.369267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaf291-ec40-4c68-9277-61b843b94510 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:24.385898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419b7c3-627b-4db3-89fb-6af6160e1f5c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:24.426785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff23fe8-5e47-40f5-94b2-cf19e0adc922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:24.427536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff23fe8-5e47-40f5-94b2-cf19e0adc922 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.427825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff23fe8-5e47-40f5-94b2-cf19e0adc922 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.428112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff23fe8-5e47-40f5-94b2-cf19e0adc922 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.429364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff23fe8-5e47-40f5-94b2-cf19e0adc922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:24.430875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff23fe8-5e47-40f5-94b2-cf19e0adc922 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:24.432834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 20/44] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:24.438737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff23fe8-5e47-40f5-94b2-cf19e0adc922 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:24.489013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaf291-ec40-4c68-9277-61b843b94510 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:24.645311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80435083-df2f-46b7-a5ad-f9c44d105827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:24.645982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435083-df2f-46b7-a5ad-f9c44d105827 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.646278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435083-df2f-46b7-a5ad-f9c44d105827 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.646561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80435083-df2f-46b7-a5ad-f9c44d105827 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.647349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80435083-df2f-46b7-a5ad-f9c44d105827 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:24.648881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80435083-df2f-46b7-a5ad-f9c44d105827 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:24.665170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 25/45] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jul 1 19:24:24 2022] POST /identity/v3/roles => generated 223 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:24:24.678122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff23fe8-5e47-40f5-94b2-cf19e0adc922 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:24.692058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:24.719750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a07b1e-015e-4eba-afbe-bd423bb28d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:24.720611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07b1e-015e-4eba-afbe-bd423bb28d2e None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:24.720994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07b1e-015e-4eba-afbe-bd423bb28d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:24.721408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07b1e-015e-4eba-afbe-bd423bb28d2e None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:24.722227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a07b1e-015e-4eba-afbe-bd423bb28d2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:24.723750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a07b1e-015e-4eba-afbe-bd423bb28d2e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:24.755782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 21/46] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:24:24 2022] POST /identity/v3/projects => generated 312 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:24:26.272310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d706-6741-4b2d-a368-3a84b9ef07b8 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:26.272845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d706-6741-4b2d-a368-3a84b9ef07b8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:26.272845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91d706-6741-4b2d-a368-3a84b9ef07b8 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:26.274267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 26/47] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:26.279915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2010-c8a1-4262-bf5a-c479ca73b0b0 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:26.280338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2010-c8a1-4262-bf5a-c479ca73b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:26.280435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e2010-c8a1-4262-bf5a-c479ca73b0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:26.298959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3b0e2010-c8a1-4262-bf5a-c479ca73b0b0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:26.300478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3b0e2010-c8a1-4262-bf5a-c479ca73b0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:26.372175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 22/48] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:26.395398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91d706-6741-4b2d-a368-3a84b9ef07b8 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:26.457736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:26.502869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91d706-6741-4b2d-a368-3a84b9ef07b8 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:26.537701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9253b07-feec-4e1f-9367-7d8faa2f8111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:26.538531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253b07-feec-4e1f-9367-7d8faa2f8111 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:26.538813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253b07-feec-4e1f-9367-7d8faa2f8111 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:26.539084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9253b07-feec-4e1f-9367-7d8faa2f8111 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:26.550941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9253b07-feec-4e1f-9367-7d8faa2f8111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-f9253b07-feec-4e1f-9367-7d8faa2f8111 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:26.559826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:26.560686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:26.561430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 27/49] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:26.568312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2010-c8a1-4262-bf5a-c479ca73b0b0 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:26.666299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:26.677034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e2010-c8a1-4262-bf5a-c479ca73b0b0 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:26.712637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87d769-7add-446a-a1ea-9f6ed4eb60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:26.713313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d769-7add-446a-a1ea-9f6ed4eb60c0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:26.713647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d769-7add-446a-a1ea-9f6ed4eb60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:26.713927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d769-7add-446a-a1ea-9f6ed4eb60c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:26.714724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87d769-7add-446a-a1ea-9f6ed4eb60c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:26.715035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87d769-7add-446a-a1ea-9f6ed4eb60c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:26.716442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87d769-7add-446a-a1ea-9f6ed4eb60c0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:26.725021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 23/50] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:26.730749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9253b07-feec-4e1f-9367-7d8faa2f8111 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:26.783264 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db63c-93ae-418e-9e00-d652642e241b None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:26.783557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db63c-93ae-418e-9e00-d652642e241b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:26.783828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2db63c-93ae-418e-9e00-d652642e241b None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:26.785329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 24/51] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:26.792536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6897-bc6e-4334-82eb-5c4c9d17afe5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:26.792830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6897-bc6e-4334-82eb-5c4c9d17afe5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:26.793111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c6897-bc6e-4334-82eb-5c4c9d17afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:26.810503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f69c6897-bc6e-4334-82eb-5c4c9d17afe5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:26.811715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f69c6897-bc6e-4334-82eb-5c4c9d17afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:26.835664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9253b07-feec-4e1f-9367-7d8faa2f8111 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:26.855999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:26.870571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fbda1-0b4f-42e6-89d0-238f0095155f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:26.871458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fbda1-0b4f-42e6-89d0-238f0095155f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:26.871735 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fbda1-0b4f-42e6-89d0-238f0095155f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:26.872006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fbda1-0b4f-42e6-89d0-238f0095155f None admin] PATH_INFO: `/v3/users/6b9038df7e244837aceca33ded6cf0a5` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:26.873209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fbda1-0b4f-42e6-89d0-238f0095155f None admin] RBAC: Authorizing `identity:get_user(user_id=6b9038df7e244837aceca33ded6cf0a5)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:26.874709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fbda1-0b4f-42e6-89d0-238f0095155f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:26.876346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 28/52] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:26 2022] GET /identity/v3/users/6b9038df7e244837aceca33ded6cf0a5 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:26.881806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fbda1-0b4f-42e6-89d0-238f0095155f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:26.888780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 25/53] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:26.912414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c6897-bc6e-4334-82eb-5c4c9d17afe5 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:26.983752 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fbda1-0b4f-42e6-89d0-238f0095155f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:26.996960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:27.013781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c6897-bc6e-4334-82eb-5c4c9d17afe5 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:27.016903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9e86-8274-4118-97b3-ff5191ad49d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:27.017702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9e86-8274-4118-97b3-ff5191ad49d1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:27.018013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9e86-8274-4118-97b3-ff5191ad49d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:27.018297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9e86-8274-4118-97b3-ff5191ad49d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:27.019486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d9e86-8274-4118-97b3-ff5191ad49d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:27.020973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d9e86-8274-4118-97b3-ff5191ad49d1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:27.022642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 29/54] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:27.028475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9e86-8274-4118-97b3-ff5191ad49d1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:27.047686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b9945-7761-416d-b56f-64bdaf38e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:27.048498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9945-7761-416d-b56f-64bdaf38e31b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:27.048778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9945-7761-416d-b56f-64bdaf38e31b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:27.049049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9945-7761-416d-b56f-64bdaf38e31b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:27.050265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b9945-7761-416d-b56f-64bdaf38e31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:27.051719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b9945-7761-416d-b56f-64bdaf38e31b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:27.053328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 26/55] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:27.058964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b9945-7761-416d-b56f-64bdaf38e31b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:27.092939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:27.138807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9e86-8274-4118-97b3-ff5191ad49d1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:27.159249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b9945-7761-416d-b56f-64bdaf38e31b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:27.172156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f238e4a-79e5-40fd-b983-a2eb50dd44d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:27.172824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238e4a-79e5-40fd-b983-a2eb50dd44d4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:27.173113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238e4a-79e5-40fd-b983-a2eb50dd44d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:27.173392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238e4a-79e5-40fd-b983-a2eb50dd44d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:27.174273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f238e4a-79e5-40fd-b983-a2eb50dd44d4 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.domain.id=default, user.id=6b9038df7e244837aceca33ded6cf0a5) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:27.174586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f238e4a-79e5-40fd-b983-a2eb50dd44d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:27.176049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f238e4a-79e5-40fd-b983-a2eb50dd44d4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:27.184863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 30/56] 10.222.0.61 () {56 vars in 1322 bytes} [Fri Jul 1 19:24:27 2022] GET /identity/v3/role_assignments?user.id=6b9038df7e244837aceca33ded6cf0a5&scope.domain.id=default&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:27.194391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3cd245-7cc4-40b0-a4bb-b26af9661c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:27.195086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd245-7cc4-40b0-a4bb-b26af9661c57 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:27.195371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd245-7cc4-40b0-a4bb-b26af9661c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:27.195647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3cd245-7cc4-40b0-a4bb-b26af9661c57 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:27.196389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cd245-7cc4-40b0-a4bb-b26af9661c57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:27.197954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3cd245-7cc4-40b0-a4bb-b26af9661c57 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:27.227646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 27/57] 10.222.0.61 () {60 vars in 1140 bytes} [Fri Jul 1 19:24:27 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:24:29.255675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd92d-7e1d-4ee1-bf7c-c9e57cda2a34 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:29.256479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd92d-7e1d-4ee1-bf7c-c9e57cda2a34 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:29.256622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd92d-7e1d-4ee1-bf7c-c9e57cda2a34 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:29.258854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 31/58] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:29.265343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234ae9c-6a72-4468-a09e-b0532ab21509 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:29.266052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234ae9c-6a72-4468-a09e-b0532ab21509 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:29.266179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234ae9c-6a72-4468-a09e-b0532ab21509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:29.275805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:29.292397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5234ae9c-6a72-4468-a09e-b0532ab21509 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:29.293655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5234ae9c-6a72-4468-a09e-b0532ab21509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:29.362794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 28/59] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:29.388017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfd92d-7e1d-4ee1-bf7c-c9e57cda2a34 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:29.516186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfd92d-7e1d-4ee1-bf7c-c9e57cda2a34 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:29.541438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:29.557748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a7574-be02-4dc6-8954-ebeb27675012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:29.558568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7574-be02-4dc6-8954-ebeb27675012 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:29.558857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7574-be02-4dc6-8954-ebeb27675012 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:29.559137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7574-be02-4dc6-8954-ebeb27675012 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:29.560396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a7574-be02-4dc6-8954-ebeb27675012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:29.561882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a7574-be02-4dc6-8954-ebeb27675012 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:29.563537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 32/60] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:29.569308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234ae9c-6a72-4468-a09e-b0532ab21509 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:29.685357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234ae9c-6a72-4468-a09e-b0532ab21509 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:29.720703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2324f32-50d7-4acf-91dd-0b7333a82a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:29.721358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324f32-50d7-4acf-91dd-0b7333a82a42 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:29.721643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324f32-50d7-4acf-91dd-0b7333a82a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:29.721918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2324f32-50d7-4acf-91dd-0b7333a82a42 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:29.722669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2324f32-50d7-4acf-91dd-0b7333a82a42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:29.724128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2324f32-50d7-4acf-91dd-0b7333a82a42 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:29.732963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:29.753623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 29/61] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:24:29 2022] POST /identity/v3/users => generated 275 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:32.592418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05249-4b3e-446c-b8d3-d8007cbc6712 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:32.592935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05249-4b3e-446c-b8d3-d8007cbc6712 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:32.593006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad05249-4b3e-446c-b8d3-d8007cbc6712 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:32.594418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 33/62] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:32.611367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41a400-d434-482e-8ae7-0307b345f9ab None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:32.612196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41a400-d434-482e-8ae7-0307b345f9ab None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:32.612664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41a400-d434-482e-8ae7-0307b345f9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:32.638860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-cc41a400-d434-482e-8ae7-0307b345f9ab None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:32.640317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cc41a400-d434-482e-8ae7-0307b345f9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:32.727099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 30/63] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:32.772554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad05249-4b3e-446c-b8d3-d8007cbc6712 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:32.904864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad05249-4b3e-446c-b8d3-d8007cbc6712 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:32.954665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e01ac-4b6d-4743-ae0b-11879427f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:32.955481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e01ac-4b6d-4743-ae0b-11879427f500 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:32.955767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e01ac-4b6d-4743-ae0b-11879427f500 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:32.956049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e01ac-4b6d-4743-ae0b-11879427f500 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:32.973780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e01ac-4b6d-4743-ae0b-11879427f500 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-753e01ac-4b6d-4743-ae0b-11879427f500 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:32.981795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:32.982657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:32.983833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 34/64] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:32.988842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41a400-d434-482e-8ae7-0307b345f9ab None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:33.133384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89314ae-ea8a-42ce-8fc0-19e2d9d358a3 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.133688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89314ae-ea8a-42ce-8fc0-19e2d9d358a3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.133976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89314ae-ea8a-42ce-8fc0-19e2d9d358a3 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.135464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 35/65] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:24:33.143476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7dc63-4967-42c4-9ab4-79976cc9232b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.143768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7dc63-4967-42c4-9ab4-79976cc9232b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.144050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7dc63-4967-42c4-9ab4-79976cc9232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.146849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41a400-d434-482e-8ae7-0307b345f9ab None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:33.171966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:33.182437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2ba7dc63-4967-42c4-9ab4-79976cc9232b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:33.184076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2ba7dc63-4967-42c4-9ab4-79976cc9232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:33.199032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:33.200064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.200549 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.201041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.202545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:33.203067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:33.205167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:33.216413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 31/66] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:33.221821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:33.271716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:33.320482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 36/67] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:33.346684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7dc63-4967-42c4-9ab4-79976cc9232b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:33.381284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d882a-00d1-44c2-b9db-40a07a5a1f0a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:33.420738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf030ea1-c70f-47b7-87e5-099c443b1aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:33.421624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030ea1-c70f-47b7-87e5-099c443b1aab None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.421902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030ea1-c70f-47b7-87e5-099c443b1aab None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.422248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf030ea1-c70f-47b7-87e5-099c443b1aab None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.444894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf030ea1-c70f-47b7-87e5-099c443b1aab None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:33.446444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf030ea1-c70f-47b7-87e5-099c443b1aab None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:33.448442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 32/68] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:33 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:33.449609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4689b-6ed1-4b39-bab3-2b144a99c0bb None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.449975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4689b-6ed1-4b39-bab3-2b144a99c0bb None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.450241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4689b-6ed1-4b39-bab3-2b144a99c0bb None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.451584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 33/69] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:33.452875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26cb6e-9f0e-4f59-b4b7-d1c7cef2f623 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.453270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26cb6e-9f0e-4f59-b4b7-d1c7cef2f623 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.453270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26cb6e-9f0e-4f59-b4b7-d1c7cef2f623 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.454857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 34/70] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:33.459206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26cb6e-9f0e-4f59-b4b7-d1c7cef2f623 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:33.495852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7dc63-4967-42c4-9ab4-79976cc9232b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:33.513096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:33.531436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe35872-2089-4ad1-ae72-2ad62e50f623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:33.532245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35872-2089-4ad1-ae72-2ad62e50f623 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.532531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35872-2089-4ad1-ae72-2ad62e50f623 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.532808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe35872-2089-4ad1-ae72-2ad62e50f623 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.543329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe35872-2089-4ad1-ae72-2ad62e50f623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-1fe35872-2089-4ad1-ae72-2ad62e50f623 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:33.550960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:33.551815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:33.552560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 37/71] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:24:33.553407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483fd6-3455-48a4-8e73-6c4a48a95871 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.553785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483fd6-3455-48a4-8e73-6c4a48a95871 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.554144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a483fd6-3455-48a4-8e73-6c4a48a95871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.570416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8a483fd6-3455-48a4-8e73-6c4a48a95871 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:33.571602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8a483fd6-3455-48a4-8e73-6c4a48a95871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:33.575121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26cb6e-9f0e-4f59-b4b7-d1c7cef2f623 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:33.603583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:33.612190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499c3b7-e89f-4b1e-ad00-29d068986abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:33.612860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499c3b7-e89f-4b1e-ad00-29d068986abd None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.613148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499c3b7-e89f-4b1e-ad00-29d068986abd None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.613427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499c3b7-e89f-4b1e-ad00-29d068986abd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.645312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 38/72] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:33.646759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272343-427e-4da1-bf09-8ef7369c561d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.647066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272343-427e-4da1-bf09-8ef7369c561d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.647326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84272343-427e-4da1-bf09-8ef7369c561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.664149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-84272343-427e-4da1-bf09-8ef7369c561d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:33.665332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-84272343-427e-4da1-bf09-8ef7369c561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:33.682444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499c3b7-e89f-4b1e-ad00-29d068986abd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:33.683859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499c3b7-e89f-4b1e-ad00-29d068986abd None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:33.725427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:33.731374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 39/73] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:33.732756 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55b464-e5ab-43f4-b76b-2a78b61dbcbc None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.733044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55b464-e5ab-43f4-b76b-2a78b61dbcbc None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.733332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55b464-e5ab-43f4-b76b-2a78b61dbcbc None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.734745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 40/74] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:33.735337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55b464-e5ab-43f4-b76b-2a78b61dbcbc None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:33.789645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 35/75] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:33.790533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499c3b7-e89f-4b1e-ad00-29d068986abd None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:33.841201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:33.846732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55b464-e5ab-43f4-b76b-2a78b61dbcbc None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:33.881770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc9422-3b2d-42d8-90d7-49103849e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:33.882474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc9422-3b2d-42d8-90d7-49103849e7fe None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.882759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc9422-3b2d-42d8-90d7-49103849e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.883039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc9422-3b2d-42d8-90d7-49103849e7fe None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.883804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc9422-3b2d-42d8-90d7-49103849e7fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:33.884124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc9422-3b2d-42d8-90d7-49103849e7fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:33.885649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc9422-3b2d-42d8-90d7-49103849e7fe None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:33.887036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499c3b7-e89f-4b1e-ad00-29d068986abd None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:33.893731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 41/76] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:33.897360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cabd7-f26c-48a5-9450-3170afa1e602 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.897623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cabd7-f26c-48a5-9450-3170afa1e602 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.897897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cabd7-f26c-48a5-9450-3170afa1e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.913712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ed2cabd7-f26c-48a5-9450-3170afa1e602 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:33.914922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ed2cabd7-f26c-48a5-9450-3170afa1e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:33.922065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a93a-9eb9-451a-87c0-a1fc5cbb676a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:33.922886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a93a-9eb9-451a-87c0-a1fc5cbb676a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:33.923163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a93a-9eb9-451a-87c0-a1fc5cbb676a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:33.923438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0a93a-9eb9-451a-87c0-a1fc5cbb676a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:33.930803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:33.934319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0a93a-9eb9-451a-87c0-a1fc5cbb676a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-53e0a93a-9eb9-451a-87c0-a1fc5cbb676a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:33.942814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:33.943685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 36/77] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:24:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:33.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a93a-9eb9-451a-87c0-a1fc5cbb676a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:33.984532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 42/78] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:33.985373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cabd7-f26c-48a5-9450-3170afa1e602 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.052115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0a93a-9eb9-451a-87c0-a1fc5cbb676a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.076346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:34.086075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2cabd7-f26c-48a5-9450-3170afa1e602 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.087923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3474f-e707-4b03-91d1-7987871dc871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.088836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3474f-e707-4b03-91d1-7987871dc871 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.089116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3474f-e707-4b03-91d1-7987871dc871 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.089413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3474f-e707-4b03-91d1-7987871dc871 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.090619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3474f-e707-4b03-91d1-7987871dc871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:34.092096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3474f-e707-4b03-91d1-7987871dc871 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:34.093707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 37/79] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:34.094510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3474f-e707-4b03-91d1-7987871dc871 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.120507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4238-1627-4878-8282-e10b4f49862b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.121373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4238-1627-4878-8282-e10b4f49862b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.121652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4238-1627-4878-8282-e10b4f49862b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.121926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4238-1627-4878-8282-e10b4f49862b None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.123158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db4238-1627-4878-8282-e10b4f49862b None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:34.124612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db4238-1627-4878-8282-e10b4f49862b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:34.126357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 43/80] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:33 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:34.127166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4238-1627-4878-8282-e10b4f49862b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.159608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:34.194002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3474f-e707-4b03-91d1-7987871dc871 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.227838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4238-1627-4878-8282-e10b4f49862b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.228200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626831-fa1a-42df-86a1-aedf6f8d5b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.229114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626831-fa1a-42df-86a1-aedf6f8d5b80 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.229413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626831-fa1a-42df-86a1-aedf6f8d5b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.229693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f626831-fa1a-42df-86a1-aedf6f8d5b80 None admin] PATH_INFO: `/v3/users/6b9038df7e244837aceca33ded6cf0a5` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.230960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f626831-fa1a-42df-86a1-aedf6f8d5b80 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9038df7e244837aceca33ded6cf0a5)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:34.232432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f626831-fa1a-42df-86a1-aedf6f8d5b80 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:34.234112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 38/81] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:34 2022] GET /identity/v3/users/6b9038df7e244837aceca33ded6cf0a5 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:34.234878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626831-fa1a-42df-86a1-aedf6f8d5b80 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.267147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.267814 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.268099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.268377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.269126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:34.269428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:34.270873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:34.278795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 44/82] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:24:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:34.279627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.301739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:34.346355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f626831-fa1a-42df-86a1-aedf6f8d5b80 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.380851 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e96ef-a865-4e24-985f-699baa96cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.381656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e96ef-a865-4e24-985f-699baa96cc4e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.381967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e96ef-a865-4e24-985f-699baa96cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.382245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e96ef-a865-4e24-985f-699baa96cc4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.384424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c147b-2909-4895-924b-4c10ddb10ba8 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.384895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:34.393559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e96ef-a865-4e24-985f-699baa96cc4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-6e2e96ef-a865-4e24-985f-699baa96cc4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:34.401445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:34.402455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:34.403323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 39/83] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:34.404088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e96ef-a865-4e24-985f-699baa96cc4e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.421034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfb99c-af19-461d-b64f-4f84e892433f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.421711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfb99c-af19-461d-b64f-4f84e892433f None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.422019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfb99c-af19-461d-b64f-4f84e892433f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.422298 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfb99c-af19-461d-b64f-4f84e892433f None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.423030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfb99c-af19-461d-b64f-4f84e892433f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:34.424485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cfb99c-af19-461d-b64f-4f84e892433f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:34.466091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 45/84] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:24:34 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:34.466091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfb99c-af19-461d-b64f-4f84e892433f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.558003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e96ef-a865-4e24-985f-699baa96cc4e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.565766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:34.600283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfb99c-af19-461d-b64f-4f84e892433f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.603433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.604203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.604498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.604784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.605647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] RBAC: Adding query filter params (role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29, user.id=bfe3b92c2dc6441793fd4e5a64a8a280) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:34.605983 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:34.607582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:34.614273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 40/85] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:34 2022] GET /identity/v3/role_assignments?user.id=bfe3b92c2dc6441793fd4e5a64a8a280&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=1cafdd847d454019a89ce61428b4a863 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:34.614273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.679019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71679e-490f-45c5-8d8f-b88a5dc34fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.679709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71679e-490f-45c5-8d8f-b88a5dc34fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.679994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71679e-490f-45c5-8d8f-b88a5dc34fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.680270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71679e-490f-45c5-8d8f-b88a5dc34fa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.725803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:34.780085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71679e-490f-45c5-8d8f-b88a5dc34fa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:34.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71679e-490f-45c5-8d8f-b88a5dc34fa3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:34.791214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0536ba2-ba96-4b06-adb0-e56bc250cc8b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:34.854327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b2a6-bb4a-478c-b0c1-7c0f414c5fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:34.855345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b2a6-bb4a-478c-b0c1-7c0f414c5fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:34.855632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b2a6-bb4a-478c-b0c1-7c0f414c5fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:34.855913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27b2a6-bb4a-478c-b0c1-7c0f414c5fd3 None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:34.857321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27b2a6-bb4a-478c-b0c1-7c0f414c5fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:34.860470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27b2a6-bb4a-478c-b0c1-7c0f414c5fd3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:34.862226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 41/86] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:34 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:34.863391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b2a6-bb4a-478c-b0c1-7c0f414c5fd3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:34.914260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:34.945016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 46/87] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:34.950744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71679e-490f-45c5-8d8f-b88a5dc34fa3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:35.063467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27b2a6-bb4a-478c-b0c1-7c0f414c5fd3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:35.064295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71679e-490f-45c5-8d8f-b88a5dc34fa3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:35.102071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf891b01-eaf6-4d53-b31d-2228b8d76465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:35.102873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf891b01-eaf6-4d53-b31d-2228b8d76465 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:35.104117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf891b01-eaf6-4d53-b31d-2228b8d76465 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:35.104117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf891b01-eaf6-4d53-b31d-2228b8d76465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:35.134967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:35.152306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:35.159267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:35.160222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:35.160691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:35.161142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:35.162108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] RBAC: Adding query filter params (name=member) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:35.162591 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:35.164173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:35.176966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf891b01-eaf6-4d53-b31d-2228b8d76465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:35.178507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf891b01-eaf6-4d53-b31d-2228b8d76465 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:35.184009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 42/88] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:35.185109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:35.340812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 47/89] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:35.343360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf891b01-eaf6-4d53-b31d-2228b8d76465 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:35.347511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b4e72-6eba-4565-952c-58a295a6c31a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:35.415635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c7e07-8b77-4a0d-9d45-a047a2c1b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:35.416975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7e07-8b77-4a0d-9d45-a047a2c1b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:35.417520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7e07-8b77-4a0d-9d45-a047a2c1b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:35.418103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c7e07-8b77-4a0d-9d45-a047a2c1b7b2 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:35.419506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c7e07-8b77-4a0d-9d45-a047a2c1b7b2 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:35.421186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c7e07-8b77-4a0d-9d45-a047a2c1b7b2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:35.423564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 43/90] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:35 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:35.424540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c7e07-8b77-4a0d-9d45-a047a2c1b7b2 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:35.478955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:35.518336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:35.526975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf891b01-eaf6-4d53-b31d-2228b8d76465 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:35.556551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c7e07-8b77-4a0d-9d45-a047a2c1b7b2 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:35.591367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826a93-bb08-4a61-a66b-3cfd2b02ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:35.592155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826a93-bb08-4a61-a66b-3cfd2b02ea7a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:35.592433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826a93-bb08-4a61-a66b-3cfd2b02ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:35.592705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826a93-bb08-4a61-a66b-3cfd2b02ea7a None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:35.593898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85826a93-bb08-4a61-a66b-3cfd2b02ea7a None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:35.595393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85826a93-bb08-4a61-a66b-3cfd2b02ea7a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:35.597410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 44/91] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:35 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:35.598308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826a93-bb08-4a61-a66b-3cfd2b02ea7a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:35.620475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788abfc-46df-4033-b913-f1102ff21faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:35.621368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788abfc-46df-4033-b913-f1102ff21faf None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:35.621663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788abfc-46df-4033-b913-f1102ff21faf None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:35.621966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788abfc-46df-4033-b913-f1102ff21faf None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:35.623185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788abfc-46df-4033-b913-f1102ff21faf None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:35.624649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788abfc-46df-4033-b913-f1102ff21faf None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:35.634493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 48/92] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:35 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:35.635559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788abfc-46df-4033-b913-f1102ff21faf None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:35.702356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826a93-bb08-4a61-a66b-3cfd2b02ea7a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:35.730309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:35.738561 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:35.739282 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:35.739568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:35.739847 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:35.740825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29, user.id=6b9038df7e244837aceca33ded6cf0a5) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:35.741149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:35.742714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:35.749337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 45/93] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:35 2022] GET /identity/v3/role_assignments?user.id=6b9038df7e244837aceca33ded6cf0a5&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:35.750178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:35.864827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852240d8-6039-4e5c-8373-5564e006b987 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:35.939040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788abfc-46df-4033-b913-f1102ff21faf None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:35.947751 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee8f0-e213-42c3-9322-b7a068b5a0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:35.948448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee8f0-e213-42c3-9322-b7a068b5a0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:35.948742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee8f0-e213-42c3-9322-b7a068b5a0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:35.949023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee8f0-e213-42c3-9322-b7a068b5a0e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:36.003724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:36.004394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:36.004679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:36.004959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:36.006438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] RBAC: Adding query filter params (role.id=048795d190224624ad8e995082b0faa0, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29, user.id=bfe3b92c2dc6441793fd4e5a64a8a280) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:36.006772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:36.008325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:36.015610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 49/94] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:35 2022] GET /identity/v3/role_assignments?user.id=bfe3b92c2dc6441793fd4e5a64a8a280&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=048795d190224624ad8e995082b0faa0 => generated 259 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:36.091772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:36.105417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dee8f0-e213-42c3-9322-b7a068b5a0e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:36.106960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dee8f0-e213-42c3-9322-b7a068b5a0e9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:36.250915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 46/95] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:36.256199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:36.272258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:36.383961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c03f8fd-a535-427d-abf8-e5da275411ea None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:36.422966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20aaee-53a8-46a5-a314-25a1d95960f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:36.423835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20aaee-53a8-46a5-a314-25a1d95960f4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:36.424122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20aaee-53a8-46a5-a314-25a1d95960f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:36.424405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20aaee-53a8-46a5-a314-25a1d95960f4 None admin] PATH_INFO: `/v3/projects/4f96a19958aa48e2b0cedeec36b609fa` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:36.425599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20aaee-53a8-46a5-a314-25a1d95960f4 None admin] RBAC: Authorizing `identity:get_project(project_id=4f96a19958aa48e2b0cedeec36b609fa)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:36.427081 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20aaee-53a8-46a5-a314-25a1d95960f4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:36.429110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 50/96] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:36 2022] GET /identity/v3/projects/4f96a19958aa48e2b0cedeec36b609fa => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:36.434707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee8f0-e213-42c3-9322-b7a068b5a0e9 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:36.548021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:36.558903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee8f0-e213-42c3-9322-b7a068b5a0e9 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:36.602110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d37b7b-c67a-4dc2-aae5-2a68001fc5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:36.602777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37b7b-c67a-4dc2-aae5-2a68001fc5bd None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:36.603063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37b7b-c67a-4dc2-aae5-2a68001fc5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:36.603392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d37b7b-c67a-4dc2-aae5-2a68001fc5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:36.604299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37b7b-c67a-4dc2-aae5-2a68001fc5bd None admin] RBAC: Adding query filter params (role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=4f96a19958aa48e2b0cedeec36b609fa, user.id=bfe3b92c2dc6441793fd4e5a64a8a280) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:36.604621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37b7b-c67a-4dc2-aae5-2a68001fc5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:36.610217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d37b7b-c67a-4dc2-aae5-2a68001fc5bd None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:36.616111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 47/97] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:36 2022] GET /identity/v3/role_assignments?user.id=bfe3b92c2dc6441793fd4e5a64a8a280&scope.project.id=4f96a19958aa48e2b0cedeec36b609fa&role.id=1cafdd847d454019a89ce61428b4a863 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:37.349366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f16e-dc4a-4df5-80a6-ceee91785567 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:37.349366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f16e-dc4a-4df5-80a6-ceee91785567 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:37.349908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c29b-7738-4ff1-8bbc-3cc329e08252 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:37.350539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53f16e-dc4a-4df5-80a6-ceee91785567 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:37.350613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c29b-7738-4ff1-8bbc-3cc329e08252 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:37.350613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d36c29b-7738-4ff1-8bbc-3cc329e08252 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:37.350726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 51/98] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:37.351268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 48/99] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:37.354554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769f6b2-5321-4854-8b5c-6cb0e9b6d08e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:37.354850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769f6b2-5321-4854-8b5c-6cb0e9b6d08e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:37.355135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769f6b2-5321-4854-8b5c-6cb0e9b6d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:37.357864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed153-a1af-4e6c-acf8-801af1a3a770 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:37.358400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed153-a1af-4e6c-acf8-801af1a3a770 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:37.358962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed153-a1af-4e6c-acf8-801af1a3a770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:37.375953 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-dbaed153-a1af-4e6c-acf8-801af1a3a770 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:37.377456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-dbaed153-a1af-4e6c-acf8-801af1a3a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:37.382979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4769f6b2-5321-4854-8b5c-6cb0e9b6d08e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:37.384178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4769f6b2-5321-4854-8b5c-6cb0e9b6d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:37.463899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 49/100] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:37.487389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaed153-a1af-4e6c-acf8-801af1a3a770 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:37.503671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 52/101] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:37.523836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563515c-05bb-4031-a408-87e1e858193a None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:37.524020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563515c-05bb-4031-a408-87e1e858193a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:37.524272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563515c-05bb-4031-a408-87e1e858193a None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:37.525968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 53/102] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:37.555455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563515c-05bb-4031-a408-87e1e858193a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:37.577180 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:37.584901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:37.593892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaed153-a1af-4e6c-acf8-801af1a3a770 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:37.631033 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35978d43-f7b8-4341-8dee-500d342c2503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:37.632181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35978d43-f7b8-4341-8dee-500d342c2503 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:37.632662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35978d43-f7b8-4341-8dee-500d342c2503 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:37.633128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35978d43-f7b8-4341-8dee-500d342c2503 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:37.644685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35978d43-f7b8-4341-8dee-500d342c2503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-35978d43-f7b8-4341-8dee-500d342c2503 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:37.653179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:37.654046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:37.654795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:37.657313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 50/103] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:24:37.663888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf80d64-6c8e-406d-926f-4a14c1ad3bc6 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:37.664392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf80d64-6c8e-406d-926f-4a14c1ad3bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:37.664880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf80d64-6c8e-406d-926f-4a14c1ad3bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:37.683000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ecf80d64-6c8e-406d-926f-4a14c1ad3bc6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:37.684439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ecf80d64-6c8e-406d-926f-4a14c1ad3bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:37.762488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 51/104] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:37.764307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf80d64-6c8e-406d-926f-4a14c1ad3bc6 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:37.844328 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563515c-05bb-4031-a408-87e1e858193a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:37.883401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:37.917239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf80d64-6c8e-406d-926f-4a14c1ad3bc6 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:37.930765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e258eb-c04c-4edf-a611-4adb96052fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:37.931948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e258eb-c04c-4edf-a611-4adb96052fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:37.932541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e258eb-c04c-4edf-a611-4adb96052fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:37.933035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e258eb-c04c-4edf-a611-4adb96052fa9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:37.934437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e258eb-c04c-4edf-a611-4adb96052fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:37.936087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e258eb-c04c-4edf-a611-4adb96052fa9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:37.937972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 54/105] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:37.939055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e258eb-c04c-4edf-a611-4adb96052fa9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:38.003251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:38.003970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.004262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.004546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.005319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:38.005630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:38.007075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:38.019988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 52/106] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:38.020784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:38.046340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:38.064452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e258eb-c04c-4edf-a611-4adb96052fa9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:38.101975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091590-f051-42e9-9e7e-4a03e726a64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:38.102791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091590-f051-42e9-9e7e-4a03e726a64f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.103081 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091590-f051-42e9-9e7e-4a03e726a64f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.103367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79091590-f051-42e9-9e7e-4a03e726a64f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.115022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79091590-f051-42e9-9e7e-4a03e726a64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-79091590-f051-42e9-9e7e-4a03e726a64f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:38.124789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:38.125658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:38.126454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 55/107] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:38.127144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091590-f051-42e9-9e7e-4a03e726a64f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:38.231132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79091590-f051-42e9-9e7e-4a03e726a64f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:38.265886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9180a9-e59f-46b6-88db-87c30571ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:38.266939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9180a9-e59f-46b6-88db-87c30571ced3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.267298 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9180a9-e59f-46b6-88db-87c30571ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.267647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9180a9-e59f-46b6-88db-87c30571ced3 None admin] PATH_INFO: `/v3/users/07a2570fd3ce462d9987ae693a84da4b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.269888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:38.284646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9180a9-e59f-46b6-88db-87c30571ced3 None admin] RBAC: Authorizing `identity:get_user(user_id=07a2570fd3ce462d9987ae693a84da4b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:38.286301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9180a9-e59f-46b6-88db-87c30571ced3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:38.288632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 56/108] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:38 2022] GET /identity/v3/users/07a2570fd3ce462d9987ae693a84da4b => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:38.289480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9180a9-e59f-46b6-88db-87c30571ced3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:38.327537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92c98f-765f-4e6a-8979-16432dd6f21a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:38.386265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e98d5-f563-4e75-9c80-0f5d13fa84d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:38.387401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e98d5-f563-4e75-9c80-0f5d13fa84d1 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.387693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e98d5-f563-4e75-9c80-0f5d13fa84d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.387970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e98d5-f563-4e75-9c80-0f5d13fa84d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.388701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e98d5-f563-4e75-9c80-0f5d13fa84d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:38.390326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e98d5-f563-4e75-9c80-0f5d13fa84d1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:38.395712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:38.422956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 53/109] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:24:38 2022] POST /identity/v3/projects => generated 302 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:38.423853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e98d5-f563-4e75-9c80-0f5d13fa84d1 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:38.540146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9180a9-e59f-46b6-88db-87c30571ced3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:38.545632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e98d5-f563-4e75-9c80-0f5d13fa84d1 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:38.591962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997b027-868d-48c6-8f6b-6e7fe2ff486c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:38.592649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b027-868d-48c6-8f6b-6e7fe2ff486c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.592937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b027-868d-48c6-8f6b-6e7fe2ff486c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.593218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997b027-868d-48c6-8f6b-6e7fe2ff486c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.624833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca19776-9de9-456c-b738-2c5204aa7b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:38.625522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19776-9de9-456c-b738-2c5204aa7b7a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.625808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19776-9de9-456c-b738-2c5204aa7b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.626129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca19776-9de9-456c-b738-2c5204aa7b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.626901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca19776-9de9-456c-b738-2c5204aa7b7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:38.627215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca19776-9de9-456c-b738-2c5204aa7b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:38.628622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca19776-9de9-456c-b738-2c5204aa7b7a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:38.643012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 57/110] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:38.644413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff5183-6db0-4605-9239-74691df38779 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.644700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff5183-6db0-4605-9239-74691df38779 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.644983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff5183-6db0-4605-9239-74691df38779 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.653697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 58/111] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:38.655114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff5183-6db0-4605-9239-74691df38779 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:38.716538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:38.735074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:38.741962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997b027-868d-48c6-8f6b-6e7fe2ff486c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:38.743816 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997b027-868d-48c6-8f6b-6e7fe2ff486c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:38.790363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff5183-6db0-4605-9239-74691df38779 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:38.835300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2270c25-5bbe-4a16-a4ba-b38034030c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:38.836449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270c25-5bbe-4a16-a4ba-b38034030c1d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.837074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270c25-5bbe-4a16-a4ba-b38034030c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.837354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2270c25-5bbe-4a16-a4ba-b38034030c1d None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.839239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2270c25-5bbe-4a16-a4ba-b38034030c1d None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:38.841228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2270c25-5bbe-4a16-a4ba-b38034030c1d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:38.843924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 59/112] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:38 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:38.845136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c209f9-52bc-4c03-a8f3-b52657080459 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:38.845435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c209f9-52bc-4c03-a8f3-b52657080459 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:38.845710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c209f9-52bc-4c03-a8f3-b52657080459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:38.867305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-35c209f9-52bc-4c03-a8f3-b52657080459 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:38.869084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-35c209f9-52bc-4c03-a8f3-b52657080459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:38.878217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 54/113] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:38.883146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997b027-868d-48c6-8f6b-6e7fe2ff486c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:38.954042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 60/114] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:38.959144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c209f9-52bc-4c03-a8f3-b52657080459 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:38.999472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:39.017355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997b027-868d-48c6-8f6b-6e7fe2ff486c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.035161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:39.069362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d610e-ac2e-4991-ad09-38bf885f5059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:39.070769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d610e-ac2e-4991-ad09-38bf885f5059 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.071162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d610e-ac2e-4991-ad09-38bf885f5059 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.071537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d610e-ac2e-4991-ad09-38bf885f5059 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.072905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d610e-ac2e-4991-ad09-38bf885f5059 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:39.075027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d610e-ac2e-4991-ad09-38bf885f5059 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:39.082000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 55/115] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:38 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:39.082000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d610e-ac2e-4991-ad09-38bf885f5059 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:39.093541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c209f9-52bc-4c03-a8f3-b52657080459 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.143115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe829-4b31-4dbf-984c-64321558f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:39.144002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe829-4b31-4dbf-984c-64321558f257 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.144291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe829-4b31-4dbf-984c-64321558f257 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.144576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe829-4b31-4dbf-984c-64321558f257 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.146067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fe829-4b31-4dbf-984c-64321558f257 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:39.148531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fe829-4b31-4dbf-984c-64321558f257 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:39.154899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 61/116] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:38 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:39.154899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9d835-550e-4107-a614-8cf5abd8c7d1 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.154899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9d835-550e-4107-a614-8cf5abd8c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.154899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9d835-550e-4107-a614-8cf5abd8c7d1 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.154899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 62/117] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:39.155587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9d835-550e-4107-a614-8cf5abd8c7d1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:39.201333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d610e-ac2e-4991-ad09-38bf885f5059 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.241215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c383f-2b36-48d9-9a40-3458019af8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:39.242425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c383f-2b36-48d9-9a40-3458019af8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.242902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c383f-2b36-48d9-9a40-3458019af8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.243384 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c383f-2b36-48d9-9a40-3458019af8b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.254342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c383f-2b36-48d9-9a40-3458019af8b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-7a3c383f-2b36-48d9-9a40-3458019af8b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:39.262515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:39.263385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:39.264123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:39.274991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 56/118] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:39.277054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800faad-7c87-49d4-b762-1d6a68dd8500 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.277552 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800faad-7c87-49d4-b762-1d6a68dd8500 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.278056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800faad-7c87-49d4-b762-1d6a68dd8500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.291462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9d835-550e-4107-a614-8cf5abd8c7d1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.296004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b800faad-7c87-49d4-b762-1d6a68dd8500 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:39.297428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b800faad-7c87-49d4-b762-1d6a68dd8500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:39.309965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:39.330052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:39.339450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c9ffb-4753-474d-b7a9-e3832b691f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:39.340496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9ffb-4753-474d-b7a9-e3832b691f32 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.340780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9ffb-4753-474d-b7a9-e3832b691f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.341061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c9ffb-4753-474d-b7a9-e3832b691f32 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/users/bfe3b92c2dc6441793fd4e5a64a8a280/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.343118 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c9ffb-4753-474d-b7a9-e3832b691f32 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d89269d1e3a4ff8be3465cf7d5bec29, user_id=bfe3b92c2dc6441793fd4e5a64a8a280, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:39.344614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c9ffb-4753-474d-b7a9-e3832b691f32 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:39.364788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 63/119] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:39 2022] PUT /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/users/bfe3b92c2dc6441793fd4e5a64a8a280/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:39.365621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c9ffb-4753-474d-b7a9-e3832b691f32 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:39.390014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 57/120] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:39.392118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800faad-7c87-49d4-b762-1d6a68dd8500 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:39.483415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c9ffb-4753-474d-b7a9-e3832b691f32 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.524173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de20122-3df3-48a7-b430-06a8dd720f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:39.525002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20122-3df3-48a7-b430-06a8dd720f7f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.525380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20122-3df3-48a7-b430-06a8dd720f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.525801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de20122-3df3-48a7-b430-06a8dd720f7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.526796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20122-3df3-48a7-b430-06a8dd720f7f None admin] RBAC: Adding query filter params (role.id=20aa0cf18e2b49ee859eef779cc3c45d, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29, user.id=07a2570fd3ce462d9987ae693a84da4b) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:39.527218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20122-3df3-48a7-b430-06a8dd720f7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:39.528815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de20122-3df3-48a7-b430-06a8dd720f7f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:39.535344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 64/121] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:39 2022] GET /identity/v3/role_assignments?user.id=07a2570fd3ce462d9987ae693a84da4b&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=20aa0cf18e2b49ee859eef779cc3c45d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:39.536379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800faad-7c87-49d4-b762-1d6a68dd8500 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.537005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a5131-20b3-4927-9581-98338df56e95 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.537389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a5131-20b3-4927-9581-98338df56e95 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.537787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a5131-20b3-4927-9581-98338df56e95 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.539491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 65/122] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:39.544880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a5131-20b3-4927-9581-98338df56e95 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:39.589198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a7f54-35e5-4dba-ad14-c0dad22937a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:39.590185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7f54-35e5-4dba-ad14-c0dad22937a8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.590626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7f54-35e5-4dba-ad14-c0dad22937a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.591048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a7f54-35e5-4dba-ad14-c0dad22937a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.592379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a7f54-35e5-4dba-ad14-c0dad22937a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:39.593885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a7f54-35e5-4dba-ad14-c0dad22937a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:39.595575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a7f54-35e5-4dba-ad14-c0dad22937a8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:39.607278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:39.609028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 58/123] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:39.611058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ec0ce-b0de-4783-ad72-7b441fbe5926 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.611540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ec0ce-b0de-4783-ad72-7b441fbe5926 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.611970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ec0ce-b0de-4783-ad72-7b441fbe5926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.637484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b87ec0ce-b0de-4783-ad72-7b441fbe5926 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:39.638956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b87ec0ce-b0de-4783-ad72-7b441fbe5926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:39.641411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:39.684610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a5131-20b3-4927-9581-98338df56e95 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.730124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 59/124] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:39.731004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ec0ce-b0de-4783-ad72-7b441fbe5926 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:39.759956 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacbda4-e72c-4d82-8fee-d2b0fc677b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:39.760838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacbda4-e72c-4d82-8fee-d2b0fc677b22 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.761123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacbda4-e72c-4d82-8fee-d2b0fc677b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.761401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacbda4-e72c-4d82-8fee-d2b0fc677b22 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.778950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacbda4-e72c-4d82-8fee-d2b0fc677b22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-aeacbda4-e72c-4d82-8fee-d2b0fc677b22 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:39.790809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:39.791870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:39.792663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 66/125] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:24:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:39.793303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacbda4-e72c-4d82-8fee-d2b0fc677b22 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:39.928408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacbda4-e72c-4d82-8fee-d2b0fc677b22 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.931154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:39.969432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2a28-ab9a-4c9a-97a1-9f277abb1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:39.970467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2a28-ab9a-4c9a-97a1-9f277abb1dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:39.970760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2a28-ab9a-4c9a-97a1-9f277abb1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:39.971041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2a28-ab9a-4c9a-97a1-9f277abb1dc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:39.981878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ec0ce-b0de-4783-ad72-7b441fbe5926 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:39.983050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2a28-ab9a-4c9a-97a1-9f277abb1dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-405a2a28-ab9a-4c9a-97a1-9f277abb1dc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:39.992194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:39.993064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:39.993829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 67/126] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:39.998354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2a28-ab9a-4c9a-97a1-9f277abb1dc7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:40.095297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7022c-6774-46ca-9e8c-2934c2c9eee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:40.096350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7022c-6774-46ca-9e8c-2934c2c9eee6 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:40.096736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7022c-6774-46ca-9e8c-2934c2c9eee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:40.097136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7022c-6774-46ca-9e8c-2934c2c9eee6 None admin] PATH_INFO: `/v3/users/6b9038df7e244837aceca33ded6cf0a5` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:40.098497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7022c-6774-46ca-9e8c-2934c2c9eee6 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9038df7e244837aceca33ded6cf0a5)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:40.100078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7022c-6774-46ca-9e8c-2934c2c9eee6 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:40.101843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 60/127] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:39 2022] GET /identity/v3/users/6b9038df7e244837aceca33ded6cf0a5 => generated 247 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:40.102722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7022c-6774-46ca-9e8c-2934c2c9eee6 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:40.115072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2a28-ab9a-4c9a-97a1-9f277abb1dc7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:40.126299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:40.156635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:40.157340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:40.157625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:40.158453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:40.159224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:40.159537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:40.160934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:40.170632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 68/128] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:24:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:40.171946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:40.225500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:40.311830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7022c-6774-46ca-9e8c-2934c2c9eee6 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:40.360765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860d7a1-3986-41c8-a18e-413cdca45f63 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:40.385857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:40.386575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:40.386862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:40.387143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:40.387908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:40.388220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:40.389615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:40.410063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 61/129] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:40.411007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:40.429378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332724-796f-4044-b933-1aef59766643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:40.430293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332724-796f-4044-b933-1aef59766643 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:40.430580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332724-796f-4044-b933-1aef59766643 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:40.430862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73332724-796f-4044-b933-1aef59766643 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:40.434056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73332724-796f-4044-b933-1aef59766643 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:40.436434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73332724-796f-4044-b933-1aef59766643 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:40.438852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 69/130] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:40 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:40.439464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332724-796f-4044-b933-1aef59766643 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:40.547090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:40.600896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:40.609528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73332724-796f-4044-b933-1aef59766643 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:40.615449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673c0ed-3c93-4e01-a10e-98fb8a3616d7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:40.656377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44b95-e226-4336-bd2f-88aa354279b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:40.657318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44b95-e226-4336-bd2f-88aa354279b7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:40.657602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44b95-e226-4336-bd2f-88aa354279b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:40.657885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44b95-e226-4336-bd2f-88aa354279b7 None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:40.660147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd44b95-e226-4336-bd2f-88aa354279b7 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:40.661615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd44b95-e226-4336-bd2f-88aa354279b7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:40.666710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 70/131] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:40 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:40.667356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44b95-e226-4336-bd2f-88aa354279b7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:40.692595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f830-b374-46ca-9fdc-9eba21d8d6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:40.693501 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f830-b374-46ca-9fdc-9eba21d8d6ea None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:40.693786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f830-b374-46ca-9fdc-9eba21d8d6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:40.694093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f830-b374-46ca-9fdc-9eba21d8d6ea None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:40.698491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f830-b374-46ca-9fdc-9eba21d8d6ea None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:40.699963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f830-b374-46ca-9fdc-9eba21d8d6ea None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:40.701652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 62/132] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:40 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:40.702448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f830-b374-46ca-9fdc-9eba21d8d6ea None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:40.799411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44b95-e226-4336-bd2f-88aa354279b7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:40.837537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca212563-4dd8-4eac-adf3-7b7cb2d571c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:40.838533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212563-4dd8-4eac-adf3-7b7cb2d571c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:40.838820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212563-4dd8-4eac-adf3-7b7cb2d571c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:40.839099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca212563-4dd8-4eac-adf3-7b7cb2d571c0 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/users/6b9038df7e244837aceca33ded6cf0a5/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:40.844082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca212563-4dd8-4eac-adf3-7b7cb2d571c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d89269d1e3a4ff8be3465cf7d5bec29, user_id=6b9038df7e244837aceca33ded6cf0a5, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:40.845575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca212563-4dd8-4eac-adf3-7b7cb2d571c0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:40.876285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 71/133] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:40 2022] PUT /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/users/6b9038df7e244837aceca33ded6cf0a5/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:40.876948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca212563-4dd8-4eac-adf3-7b7cb2d571c0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:40.927356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:40.933080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f830-b374-46ca-9fdc-9eba21d8d6ea None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:41.008381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2585f36-6565-4e91-865b-2322a71eb7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:41.009269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585f36-6565-4e91-865b-2322a71eb7bf None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.009555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585f36-6565-4e91-865b-2322a71eb7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.009830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2585f36-6565-4e91-865b-2322a71eb7bf None admin] PATH_INFO: `/v3/projects/4f96a19958aa48e2b0cedeec36b609fa` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.012020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2585f36-6565-4e91-865b-2322a71eb7bf None admin] RBAC: Authorizing `identity:get_project(project_id=4f96a19958aa48e2b0cedeec36b609fa)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:41.013502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2585f36-6565-4e91-865b-2322a71eb7bf None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:41.015476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 63/134] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:40 2022] GET /identity/v3/projects/4f96a19958aa48e2b0cedeec36b609fa => generated 312 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:41.025157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2585f36-6565-4e91-865b-2322a71eb7bf None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:41.030668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:41.082753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca212563-4dd8-4eac-adf3-7b7cb2d571c0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:41.145915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fa29a-32c9-4e16-9096-f127b8e1e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:41.146922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa29a-32c9-4e16-9096-f127b8e1e857 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.147216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa29a-32c9-4e16-9096-f127b8e1e857 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.149359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa29a-32c9-4e16-9096-f127b8e1e857 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.150801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fa29a-32c9-4e16-9096-f127b8e1e857 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:41.152246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fa29a-32c9-4e16-9096-f127b8e1e857 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:41.156114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 72/135] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:40 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:41.159294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e256-f342-4ac1-9161-ef15795d3370 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.159589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e256-f342-4ac1-9161-ef15795d3370 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.159874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c40e256-f342-4ac1-9161-ef15795d3370 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.161160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 73/136] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:41.167816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd09b9d-6a60-4d90-9d08-06191c68b166 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.168113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd09b9d-6a60-4d90-9d08-06191c68b166 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.168400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd09b9d-6a60-4d90-9d08-06191c68b166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.187236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-0bd09b9d-6a60-4d90-9d08-06191c68b166 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:41.188433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0bd09b9d-6a60-4d90-9d08-06191c68b166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:41.190159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2585f36-6565-4e91-865b-2322a71eb7bf None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:41.232472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e71e4-747a-4d59-ab51-9a92aa8719d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:41.233378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e71e4-747a-4d59-ab51-9a92aa8719d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.233715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e71e4-747a-4d59-ab51-9a92aa8719d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.234022 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e71e4-747a-4d59-ab51-9a92aa8719d2 None admin] PATH_INFO: `/v3/projects/4f96a19958aa48e2b0cedeec36b609fa/users/bfe3b92c2dc6441793fd4e5a64a8a280/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.236365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e71e4-747a-4d59-ab51-9a92aa8719d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f96a19958aa48e2b0cedeec36b609fa, user_id=bfe3b92c2dc6441793fd4e5a64a8a280, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:41.237662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e71e4-747a-4d59-ab51-9a92aa8719d2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:41.256404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 64/137] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:41 2022] PUT /identity/v3/projects/4f96a19958aa48e2b0cedeec36b609fa/users/bfe3b92c2dc6441793fd4e5a64a8a280/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:41.257725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e71e4-747a-4d59-ab51-9a92aa8719d2 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:41.269131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 74/138] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:41.298049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd09b9d-6a60-4d90-9d08-06191c68b166 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:41.339314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:41.424987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:41.522386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e71e4-747a-4d59-ab51-9a92aa8719d2 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:41.552237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd09b9d-6a60-4d90-9d08-06191c68b166 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:41.578417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51936ac-2339-45e5-8157-8e1c97e7be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:41.579789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51936ac-2339-45e5-8157-8e1c97e7be82 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.580082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51936ac-2339-45e5-8157-8e1c97e7be82 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.580361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51936ac-2339-45e5-8157-8e1c97e7be82 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/users/bfe3b92c2dc6441793fd4e5a64a8a280/roles/048795d190224624ad8e995082b0faa0` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.582696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51936ac-2339-45e5-8157-8e1c97e7be82 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d89269d1e3a4ff8be3465cf7d5bec29, user_id=bfe3b92c2dc6441793fd4e5a64a8a280, role_id=048795d190224624ad8e995082b0faa0)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:41.584718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51936ac-2339-45e5-8157-8e1c97e7be82 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:41.608974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 65/139] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:41 2022] PUT /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/users/bfe3b92c2dc6441793fd4e5a64a8a280/roles/048795d190224624ad8e995082b0faa0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:41.623590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43911-be96-40ef-93d0-fdecc97a376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:41.624453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43911-be96-40ef-93d0-fdecc97a376e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.624749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43911-be96-40ef-93d0-fdecc97a376e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.625028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43911-be96-40ef-93d0-fdecc97a376e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.626411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a43911-be96-40ef-93d0-fdecc97a376e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:41.627987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a43911-be96-40ef-93d0-fdecc97a376e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:41.630135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 75/140] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:41.637220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51936ac-2339-45e5-8157-8e1c97e7be82 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:41.793803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51936ac-2339-45e5-8157-8e1c97e7be82 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:41.829533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:41.843744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f87371-189f-4f48-9b03-3245ad1f3124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:41.844433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87371-189f-4f48-9b03-3245ad1f3124 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.844721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87371-189f-4f48-9b03-3245ad1f3124 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.845004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f87371-189f-4f48-9b03-3245ad1f3124 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.845741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f87371-189f-4f48-9b03-3245ad1f3124 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:41.847239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f87371-189f-4f48-9b03-3245ad1f3124 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:41.875443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 66/141] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:24:41 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:41.948868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f463f1-ea92-49ce-8f01-93cc537cc7d4 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.949218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f463f1-ea92-49ce-8f01-93cc537cc7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.949456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f463f1-ea92-49ce-8f01-93cc537cc7d4 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.950917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 76/142] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:41.956611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e0498-c11e-4f3f-a8af-6d5d48c939b6 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:41.956908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e0498-c11e-4f3f-a8af-6d5d48c939b6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:41.957211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e0498-c11e-4f3f-a8af-6d5d48c939b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:41.983894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-385e0498-c11e-4f3f-a8af-6d5d48c939b6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:41.985119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-385e0498-c11e-4f3f-a8af-6d5d48c939b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:42.077871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 67/143] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:42.120795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f463f1-ea92-49ce-8f01-93cc537cc7d4 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:42.238094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:42.243789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50636c1-fca2-44e7-a4ba-b28af5f30e9e None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:42.244097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50636c1-fca2-44e7-a4ba-b28af5f30e9e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:42.245204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50636c1-fca2-44e7-a4ba-b28af5f30e9e None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:42.246642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 68/144] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:42.252745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4924-4c96-444f-88a1-d3de71c69782 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:42.253037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4924-4c96-444f-88a1-d3de71c69782 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:42.253319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c4924-4c96-444f-88a1-d3de71c69782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:42.255549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f463f1-ea92-49ce-8f01-93cc537cc7d4 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:42.279337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-6a1c4924-4c96-444f-88a1-d3de71c69782 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:42.280544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6a1c4924-4c96-444f-88a1-d3de71c69782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:42.322695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc791b4-c153-4971-9324-f362e065a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:42.323544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc791b4-c153-4971-9324-f362e065a429 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:42.323831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc791b4-c153-4971-9324-f362e065a429 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:42.324113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc791b4-c153-4971-9324-f362e065a429 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:42.340614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc791b4-c153-4971-9324-f362e065a429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-fdc791b4-c153-4971-9324-f362e065a429 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:42.348668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:42.349626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:42.350424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:42.352782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 77/145] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:42.362422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc791b4-c153-4971-9324-f362e065a429 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:42.429329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 69/146] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:42.464649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c4924-4c96-444f-88a1-d3de71c69782 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:42.473720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc791b4-c153-4971-9324-f362e065a429 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:42.520919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:42.522074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:42.522574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:42.523046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:42.524026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:42.524562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:42.526264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:42.535757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 78/147] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:42.541420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:42.554904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:42.555448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:42.662838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c4924-4c96-444f-88a1-d3de71c69782 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:42.701415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba9818e-63f6-4f9b-97bf-9540d736fc9e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:42.722487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4293-4af3-429d-8a63-a747cb42af6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:42.723822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4293-4af3-429d-8a63-a747cb42af6f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:42.724411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4293-4af3-429d-8a63-a747cb42af6f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:42.725009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc4293-4af3-429d-8a63-a747cb42af6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:42.742168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc4293-4af3-429d-8a63-a747cb42af6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-60cc4293-4af3-429d-8a63-a747cb42af6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:42.752884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:42.753922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:42.754869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:42.757454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 70/148] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:24:42.759590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd395cd-59d2-4501-a86a-3a50950f93c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:42.760697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd395cd-59d2-4501-a86a-3a50950f93c0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:42.761122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd395cd-59d2-4501-a86a-3a50950f93c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:42.761538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd395cd-59d2-4501-a86a-3a50950f93c0 None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:42.762916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd395cd-59d2-4501-a86a-3a50950f93c0 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:42.764487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd395cd-59d2-4501-a86a-3a50950f93c0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:42.767213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4293-4af3-429d-8a63-a747cb42af6f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:42.770130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 79/149] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:42 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:42.775369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd395cd-59d2-4501-a86a-3a50950f93c0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:42.905548 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:42.909448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc4293-4af3-429d-8a63-a747cb42af6f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:42.955360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:42.956459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:42.956955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:42.958241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:42.959148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:42.959593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:42.963693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:42.972214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:42.977802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 71/150] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:42.985063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:43.017224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd395cd-59d2-4501-a86a-3a50950f93c0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:43.085857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e756d-576e-4943-a109-715c66a819bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:43.086882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e756d-576e-4943-a109-715c66a819bf None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:43.087167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e756d-576e-4943-a109-715c66a819bf None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:43.087446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e756d-576e-4943-a109-715c66a819bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:43.157381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa35e63-0fce-42f3-a3ec-b7bae821cef0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:43.182153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e756d-576e-4943-a109-715c66a819bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:43.184045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e756d-576e-4943-a109-715c66a819bf None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:43.205551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e32e4d-943a-40fa-b1d6-e1f0ad6c4ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:43.206466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32e4d-943a-40fa-b1d6-e1f0ad6c4ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:43.206929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32e4d-943a-40fa-b1d6-e1f0ad6c4ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:43.207596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e32e4d-943a-40fa-b1d6-e1f0ad6c4ec3 None admin] PATH_INFO: `/v3/users/07a2570fd3ce462d9987ae693a84da4b` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:43.210356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e32e4d-943a-40fa-b1d6-e1f0ad6c4ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=07a2570fd3ce462d9987ae693a84da4b)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:43.212377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e32e4d-943a-40fa-b1d6-e1f0ad6c4ec3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:43.214817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 72/151] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:42 2022] GET /identity/v3/users/07a2570fd3ce462d9987ae693a84da4b => generated 289 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:43.223063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e32e4d-943a-40fa-b1d6-e1f0ad6c4ec3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:43.266004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:43.299536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:43.325426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 80/152] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:43.331662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e756d-576e-4943-a109-715c66a819bf None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:43.344576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e32e4d-943a-40fa-b1d6-e1f0ad6c4ec3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:43.378699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de181f26-650f-4c50-92fa-0315e1b59eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:43.379820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de181f26-650f-4c50-92fa-0315e1b59eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:43.380288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de181f26-650f-4c50-92fa-0315e1b59eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:43.380746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de181f26-650f-4c50-92fa-0315e1b59eb0 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:43.382083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de181f26-650f-4c50-92fa-0315e1b59eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:43.383734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de181f26-650f-4c50-92fa-0315e1b59eb0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:43.385753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 73/153] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:43 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:43.407784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de181f26-650f-4c50-92fa-0315e1b59eb0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:43.450300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e756d-576e-4943-a109-715c66a819bf None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:43.488111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f0e98-b147-4ada-9298-5fde18f38835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:43.489179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f0e98-b147-4ada-9298-5fde18f38835 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:43.489565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f0e98-b147-4ada-9298-5fde18f38835 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:43.489987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16f0e98-b147-4ada-9298-5fde18f38835 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:43.491334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f0e98-b147-4ada-9298-5fde18f38835 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:43.493005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16f0e98-b147-4ada-9298-5fde18f38835 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:43.495020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 81/154] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:43 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:43.500990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f0e98-b147-4ada-9298-5fde18f38835 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:43.514958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:43.519412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de181f26-650f-4c50-92fa-0315e1b59eb0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:43.554292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:43.555416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d69c5e-40e8-490d-b4d0-7ec8cc5f123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:43.556474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69c5e-40e8-490d-b4d0-7ec8cc5f123a None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:43.556935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69c5e-40e8-490d-b4d0-7ec8cc5f123a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:43.557340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d69c5e-40e8-490d-b4d0-7ec8cc5f123a None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/users/07a2570fd3ce462d9987ae693a84da4b/roles/20aa0cf18e2b49ee859eef779cc3c45d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:43.560260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d69c5e-40e8-490d-b4d0-7ec8cc5f123a None admin] RBAC: Authorizing `identity:create_grant(project_id=6d89269d1e3a4ff8be3465cf7d5bec29, user_id=07a2570fd3ce462d9987ae693a84da4b, role_id=20aa0cf18e2b49ee859eef779cc3c45d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:43.561867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d69c5e-40e8-490d-b4d0-7ec8cc5f123a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:43.578006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 74/155] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:43 2022] PUT /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/users/07a2570fd3ce462d9987ae693a84da4b/roles/20aa0cf18e2b49ee859eef779cc3c45d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:43.626472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16f0e98-b147-4ada-9298-5fde18f38835 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:43.665998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083927e-79ed-462c-818c-c49de9077a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:43.666817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083927e-79ed-462c-818c-c49de9077a40 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:43.667106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083927e-79ed-462c-818c-c49de9077a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:43.667381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083927e-79ed-462c-818c-c49de9077a40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:43.668247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083927e-79ed-462c-818c-c49de9077a40 None admin] RBAC: Adding query filter params (role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29, user.id=bfe3b92c2dc6441793fd4e5a64a8a280) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:43.668564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083927e-79ed-462c-818c-c49de9077a40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:43.670389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083927e-79ed-462c-818c-c49de9077a40 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:43.681265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 82/156] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:43 2022] GET /identity/v3/role_assignments?user.id=bfe3b92c2dc6441793fd4e5a64a8a280&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=1cafdd847d454019a89ce61428b4a863 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:44.405862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52b99-fbb1-4564-8d00-3ab8a6069307 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:44.406555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52b99-fbb1-4564-8d00-3ab8a6069307 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:44.407046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52b99-fbb1-4564-8d00-3ab8a6069307 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:44.408870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 75/157] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:44.419563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553702-a493-4535-a181-eb47dca02ed3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:44.420066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553702-a493-4535-a181-eb47dca02ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:44.420148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20553702-a493-4535-a181-eb47dca02ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:44.442945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-20553702-a493-4535-a181-eb47dca02ed3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:44.444156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-20553702-a493-4535-a181-eb47dca02ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:44.533562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 83/158] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:44.568814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc52b99-fbb1-4564-8d00-3ab8a6069307 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:44.701190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc52b99-fbb1-4564-8d00-3ab8a6069307 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:44.746858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165a1cd-80e2-4ecc-85bd-f5cafe02bd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:44.748037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165a1cd-80e2-4ecc-85bd-f5cafe02bd46 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:44.748507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165a1cd-80e2-4ecc-85bd-f5cafe02bd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:44.748960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165a1cd-80e2-4ecc-85bd-f5cafe02bd46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:44.763538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165a1cd-80e2-4ecc-85bd-f5cafe02bd46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-8165a1cd-80e2-4ecc-85bd-f5cafe02bd46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:44.771873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:44.772797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:44.773642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:44.776384 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 76/159] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:44.781913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20553702-a493-4535-a181-eb47dca02ed3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:44.848311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:44.918691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20553702-a493-4535-a181-eb47dca02ed3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:44.957443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:44.958051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:44.958337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:44.958612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:44.959403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:44.959671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:44.961058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:44.974322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 84/160] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:44.979109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165a1cd-80e2-4ecc-85bd-f5cafe02bd46 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:45.028823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:45.152662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165a1cd-80e2-4ecc-85bd-f5cafe02bd46 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:45.206674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a711cef-6700-46dc-a46c-188480591a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:45.207624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a711cef-6700-46dc-a46c-188480591a55 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.207931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a711cef-6700-46dc-a46c-188480591a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.208110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a711cef-6700-46dc-a46c-188480591a55 None admin] PATH_INFO: `/v3/users/6b9038df7e244837aceca33ded6cf0a5` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.209343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a711cef-6700-46dc-a46c-188480591a55 None admin] RBAC: Authorizing `identity:get_user(user_id=6b9038df7e244837aceca33ded6cf0a5)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:45.210824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a711cef-6700-46dc-a46c-188480591a55 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:45.213215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 77/161] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:44 2022] GET /identity/v3/users/6b9038df7e244837aceca33ded6cf0a5 => generated 247 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:45.218681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:45.256825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9973-4342-40f9-99c0-b6f4b44fbf77 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.257237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9973-4342-40f9-99c0-b6f4b44fbf77 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.257360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba9973-4342-40f9-99c0-b6f4b44fbf77 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.258762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 78/162] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:24:45.271000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb85dd-0964-4086-82f3-28f8b123ccb0 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.271151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb85dd-0964-4086-82f3-28f8b123ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.271403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb85dd-0964-4086-82f3-28f8b123ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.302961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-44fb85dd-0964-4086-82f3-28f8b123ccb0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:45.304116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-44fb85dd-0964-4086-82f3-28f8b123ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:45.368707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ee6a-6d74-4088-accc-d403c40b9333 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:45.370904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:45.426681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fd1e-52b9-4940-a9f6-3007f55d2c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:45.428199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fd1e-52b9-4940-a9f6-3007f55d2c39 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.428684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fd1e-52b9-4940-a9f6-3007f55d2c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.429151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8fd1e-52b9-4940-a9f6-3007f55d2c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.447329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 79/163] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:45.523366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22195961-db9a-47f3-b63c-f1d712e044dc None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.523960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22195961-db9a-47f3-b63c-f1d712e044dc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.524436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22195961-db9a-47f3-b63c-f1d712e044dc None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.528488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8fd1e-52b9-4940-a9f6-3007f55d2c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:45.529043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 80/164] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:24:45.530117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8fd1e-52b9-4940-a9f6-3007f55d2c39 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:45.535005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7c3a-eeb5-48bf-bb5b-beea50f92210 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.535568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7c3a-eeb5-48bf-bb5b-beea50f92210 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.536025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef7c3a-eeb5-48bf-bb5b-beea50f92210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.562089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bbef7c3a-eeb5-48bf-bb5b-beea50f92210 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:45.563615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bbef7c3a-eeb5-48bf-bb5b-beea50f92210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:45.576688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:45.660504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 85/165] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:45.662063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fd1e-52b9-4940-a9f6-3007f55d2c39 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:45.664700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:45.678156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 81/166] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:45.687081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef7c3a-eeb5-48bf-bb5b-beea50f92210 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:45.810053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8fd1e-52b9-4940-a9f6-3007f55d2c39 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:45.865361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef7c3a-eeb5-48bf-bb5b-beea50f92210 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:45.874119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc1f2-ad50-4bed-8871-0290d0ddbf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:45.874942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc1f2-ad50-4bed-8871-0290d0ddbf28 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.875221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc1f2-ad50-4bed-8871-0290d0ddbf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.875596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbc1f2-ad50-4bed-8871-0290d0ddbf28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.894823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbc1f2-ad50-4bed-8871-0290d0ddbf28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-17bbc1f2-ad50-4bed-8871-0290d0ddbf28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:45.903241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:45.904089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:45.905159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 86/167] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:24:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:45.905786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc1f2-ad50-4bed-8871-0290d0ddbf28 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:45.918643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647f4ce-1fe9-4306-9417-00c1f5cdd020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:45.919523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647f4ce-1fe9-4306-9417-00c1f5cdd020 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.919808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647f4ce-1fe9-4306-9417-00c1f5cdd020 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.920081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647f4ce-1fe9-4306-9417-00c1f5cdd020 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.921280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647f4ce-1fe9-4306-9417-00c1f5cdd020 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:45.922780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647f4ce-1fe9-4306-9417-00c1f5cdd020 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:45.924960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 82/168] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:45 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:45.925911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3fd11-940c-42c9-9752-a1cb97436b37 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:45.926223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3fd11-940c-42c9-9752-a1cb97436b37 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:45.926500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3fd11-940c-42c9-9752-a1cb97436b37 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:45.927707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 83/169] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:45.936798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3fd11-940c-42c9-9752-a1cb97436b37 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:45.975334 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:45.977408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:46.034350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbc1f2-ad50-4bed-8871-0290d0ddbf28 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.098566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8788ad4-92e7-466d-9309-dce0939074d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.099464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8788ad4-92e7-466d-9309-dce0939074d0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.099740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8788ad4-92e7-466d-9309-dce0939074d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.100011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8788ad4-92e7-466d-9309-dce0939074d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.122258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3fd11-940c-42c9-9752-a1cb97436b37 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.126906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8788ad4-92e7-466d-9309-dce0939074d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-f8788ad4-92e7-466d-9309-dce0939074d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:46.134886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:46.136074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:46.136935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 87/170] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:46.146120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8788ad4-92e7-466d-9309-dce0939074d0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:46.171191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c126673-abda-4e0a-a803-cb98e1450ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.171892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126673-abda-4e0a-a803-cb98e1450ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.172176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126673-abda-4e0a-a803-cb98e1450ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.172451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c126673-abda-4e0a-a803-cb98e1450ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.173217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c126673-abda-4e0a-a803-cb98e1450ac2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:46.173524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c126673-abda-4e0a-a803-cb98e1450ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:46.174982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c126673-abda-4e0a-a803-cb98e1450ac2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:46.190178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 84/171] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:46.194445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893785ae-d783-4882-bfcd-51dc4b382173 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.194731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893785ae-d783-4882-bfcd-51dc4b382173 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.195010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893785ae-d783-4882-bfcd-51dc4b382173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.226287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-893785ae-d783-4882-bfcd-51dc4b382173 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:46.227542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-893785ae-d783-4882-bfcd-51dc4b382173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:46.314423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 85/172] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:46.315314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893785ae-d783-4882-bfcd-51dc4b382173 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:46.324597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:46.368098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8788ad4-92e7-466d-9309-dce0939074d0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.422710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893785ae-d783-4882-bfcd-51dc4b382173 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.427030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:46.459657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.460322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.460754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.460921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.461713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.462035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.462413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.462779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.463075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] RBAC: Adding query filter params (name=member) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:46.463519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:46.463958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29, user.id=6b9038df7e244837aceca33ded6cf0a5) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:46.464355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:46.465328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:46.466038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:46.474159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 86/173] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:46.479358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:46.487806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 88/174] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:46 2022] GET /identity/v3/role_assignments?user.id=6b9038df7e244837aceca33ded6cf0a5&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:46.488739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:46.557113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:46.596103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d52bc-cc13-4f50-8738-729469218823 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.634485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff04d2-667e-4fdc-8373-2af9a28ae272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.636064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff04d2-667e-4fdc-8373-2af9a28ae272 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.636710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff04d2-667e-4fdc-8373-2af9a28ae272 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.637176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff04d2-667e-4fdc-8373-2af9a28ae272 None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.639136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff04d2-667e-4fdc-8373-2af9a28ae272 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:46.640881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff04d2-667e-4fdc-8373-2af9a28ae272 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:46.643077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 87/175] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:46 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:46.644344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff04d2-667e-4fdc-8373-2af9a28ae272 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:46.710337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9a175-a9cc-46c4-9cf9-3a45b0fd59cc None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.749923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87193-f0db-4f4f-a908-e22a278ab1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.751051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87193-f0db-4f4f-a908-e22a278ab1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.751480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87193-f0db-4f4f-a908-e22a278ab1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.751895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87193-f0db-4f4f-a908-e22a278ab1a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.768530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff04d2-667e-4fdc-8373-2af9a28ae272 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.782961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e87193-f0db-4f4f-a908-e22a278ab1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-e9e87193-f0db-4f4f-a908-e22a278ab1a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:46.797906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:46.798830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:46.799604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 89/176] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:46.801022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87193-f0db-4f4f-a908-e22a278ab1a6 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:46.821189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88a377-55a9-4dbb-bc35-893644e0e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.822134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a377-55a9-4dbb-bc35-893644e0e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.822735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a377-55a9-4dbb-bc35-893644e0e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.822735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a377-55a9-4dbb-bc35-893644e0e4e1 None admin] PATH_INFO: `/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.824585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88a377-55a9-4dbb-bc35-893644e0e4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=bfe3b92c2dc6441793fd4e5a64a8a280)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:46.826507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88a377-55a9-4dbb-bc35-893644e0e4e1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:46.829196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 88/177] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:46 2022] GET /identity/v3/users/bfe3b92c2dc6441793fd4e5a64a8a280 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:46.834662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3574a0-bd93-4365-a15b-d7ebcca51c50 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.834662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3574a0-bd93-4365-a15b-d7ebcca51c50 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.834662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3574a0-bd93-4365-a15b-d7ebcca51c50 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.837284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 89/178] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:46.840842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3574a0-bd93-4365-a15b-d7ebcca51c50 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:46.849380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:46.890045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:46.948708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87193-f0db-4f4f-a908-e22a278ab1a6 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.961155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3574a0-bd93-4365-a15b-d7ebcca51c50 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:46.983485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6eac9-12cd-441b-88ea-1345fcd6dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.984133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6eac9-12cd-441b-88ea-1345fcd6dfdd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.984412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6eac9-12cd-441b-88ea-1345fcd6dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.984684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6eac9-12cd-441b-88ea-1345fcd6dfdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.994416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:46.995075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:46.995354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:46.995622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:46.996364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:46.996674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:46.998093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.010821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 90/179] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:47.010821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.056377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6eac9-12cd-441b-88ea-1345fcd6dfdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:47.057882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6eac9-12cd-441b-88ea-1345fcd6dfdd None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.070683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.102835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.104923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00c265-6fc8-4eef-8537-613e6179ef70 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:47.137486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5bcf8-c44b-4f8a-815c-293e1eeab205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:47.138140 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5bcf8-c44b-4f8a-815c-293e1eeab205 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.138419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5bcf8-c44b-4f8a-815c-293e1eeab205 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.138688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5bcf8-c44b-4f8a-815c-293e1eeab205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.156135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 90/180] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:47.157479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce790bd3-0b9b-444f-a349-1febb7890df1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.157768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce790bd3-0b9b-444f-a349-1febb7890df1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.158085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce790bd3-0b9b-444f-a349-1febb7890df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.174705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ce790bd3-0b9b-444f-a349-1febb7890df1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:47.175881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ce790bd3-0b9b-444f-a349-1febb7890df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:47.206827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5bcf8-c44b-4f8a-815c-293e1eeab205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:47.208312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5bcf8-c44b-4f8a-815c-293e1eeab205 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.244908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 91/181] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:47.246258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd089-2c3c-45bb-ab94-9a49eaa276bf None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.246541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd089-2c3c-45bb-ab94-9a49eaa276bf None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.246819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdd089-2c3c-45bb-ab94-9a49eaa276bf None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.250309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 92/182] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:47.250309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e515c-3c30-406e-ac8a-b935d64f96aa None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.250309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e515c-3c30-406e-ac8a-b935d64f96aa None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.250309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e515c-3c30-406e-ac8a-b935d64f96aa None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.250826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 93/183] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:47.251511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e515c-3c30-406e-ac8a-b935d64f96aa None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.274906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.309343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 91/184] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:47.310185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5bcf8-c44b-4f8a-815c-293e1eeab205 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.331737 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.355376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e515c-3c30-406e-ac8a-b935d64f96aa None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:47.388781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6a315-9c98-4c31-8dae-898900431b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:47.389652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a315-9c98-4c31-8dae-898900431b27 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.389936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a315-9c98-4c31-8dae-898900431b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.390239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6a315-9c98-4c31-8dae-898900431b27 None admin] PATH_INFO: `/v3/users/5d34143b2f0147a9845f3a75f9a5098d` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.403219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6a315-9c98-4c31-8dae-898900431b27 None admin] RBAC: Authorizing `identity:get_user(user_id=5d34143b2f0147a9845f3a75f9a5098d)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:47.404686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6a315-9c98-4c31-8dae-898900431b27 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.406672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 94/185] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/users/5d34143b2f0147a9845f3a75f9a5098d => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:47.407825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dbbee-2618-4448-9dd3-77791eca97a7 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.408108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dbbee-2618-4448-9dd3-77791eca97a7 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.408381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dbbee-2618-4448-9dd3-77791eca97a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.412018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5bcf8-c44b-4f8a-815c-293e1eeab205 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:47.424398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2c1dbbee-2618-4448-9dd3-77791eca97a7 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:47.425587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2c1dbbee-2618-4448-9dd3-77791eca97a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:47.445652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664d769-21df-4dd2-810c-68361b658b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:47.446549 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d769-21df-4dd2-810c-68361b658b30 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.446825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d769-21df-4dd2-810c-68361b658b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.447094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664d769-21df-4dd2-810c-68361b658b30 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.448340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664d769-21df-4dd2-810c-68361b658b30 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:47.449786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664d769-21df-4dd2-810c-68361b658b30 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.451539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 92/186] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:47.452656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94831-c9a9-4d31-8585-d1ffe23b1e06 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.452937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94831-c9a9-4d31-8585-d1ffe23b1e06 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.453211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e94831-c9a9-4d31-8585-d1ffe23b1e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.469148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-97e94831-c9a9-4d31-8585-d1ffe23b1e06 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:47.470380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-97e94831-c9a9-4d31-8585-d1ffe23b1e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:47.494539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 95/187] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:47.495439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dbbee-2618-4448-9dd3-77791eca97a7 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.517518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.540417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 93/188] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:47.541060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e94831-c9a9-4d31-8585-d1ffe23b1e06 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.566283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.605335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dbbee-2618-4448-9dd3-77791eca97a7 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:47.640734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e94831-c9a9-4d31-8585-d1ffe23b1e06 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:47.641577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413ac53-1b37-4364-be9f-45a9853a1ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:47.642400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413ac53-1b37-4364-be9f-45a9853a1ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.642678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413ac53-1b37-4364-be9f-45a9853a1ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.642947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413ac53-1b37-4364-be9f-45a9853a1ef5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.644111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413ac53-1b37-4364-be9f-45a9853a1ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:47.645562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413ac53-1b37-4364-be9f-45a9853a1ef5 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.647212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 96/189] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:47.651932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413ac53-1b37-4364-be9f-45a9853a1ef5 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.674743 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a390e-84fb-4602-a557-f03435af98a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:47.675627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a390e-84fb-4602-a557-f03435af98a5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.675910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a390e-84fb-4602-a557-f03435af98a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.676182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a390e-84fb-4602-a557-f03435af98a5 None admin] PATH_INFO: `/v3/projects/4f96a19958aa48e2b0cedeec36b609fa` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.677404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a390e-84fb-4602-a557-f03435af98a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4f96a19958aa48e2b0cedeec36b609fa)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:47.678896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a390e-84fb-4602-a557-f03435af98a5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.680606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 94/190] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/projects/4f96a19958aa48e2b0cedeec36b609fa => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:47.681357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a390e-84fb-4602-a557-f03435af98a5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.714540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.751776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413ac53-1b37-4364-be9f-45a9853a1ef5 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:47.781568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.782911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a390e-84fb-4602-a557-f03435af98a5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:47.787341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a68e5-82be-489c-81c7-9e2f7672e789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:47.787989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a68e5-82be-489c-81c7-9e2f7672e789 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.788271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a68e5-82be-489c-81c7-9e2f7672e789 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.788548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a68e5-82be-489c-81c7-9e2f7672e789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.815949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:47.816623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.816904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.817163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:47.818028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] RBAC: Adding query filter params (role.id=048795d190224624ad8e995082b0faa0, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29, user.id=bfe3b92c2dc6441793fd4e5a64a8a280) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:47.818341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:47.819782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.826215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 95/191] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/role_assignments?user.id=bfe3b92c2dc6441793fd4e5a64a8a280&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=048795d190224624ad8e995082b0faa0 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:47.827053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.864526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a68e5-82be-489c-81c7-9e2f7672e789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:47.866268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a68e5-82be-489c-81c7-9e2f7672e789 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:47.934030 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:47.942088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13de7f-3726-4ded-b1a6-c6d640d7bfbf None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:47.982485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 97/192] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:47.983858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a68e5-82be-489c-81c7-9e2f7672e789 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:47.983959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffc0c7-8906-489c-8881-4c7d9cee3d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:47.985372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffc0c7-8906-489c-8881-4c7d9cee3d35 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:47.985372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffc0c7-8906-489c-8881-4c7d9cee3d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:47.985530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffc0c7-8906-489c-8881-4c7d9cee3d35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.001275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffc0c7-8906-489c-8881-4c7d9cee3d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-70ffc0c7-8906-489c-8881-4c7d9cee3d35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:48.010124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:48.011000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 96/193] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:48.012333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffc0c7-8906-489c-8881-4c7d9cee3d35 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.026837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:48.101773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a68e5-82be-489c-81c7-9e2f7672e789 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.114322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffc0c7-8906-489c-8881-4c7d9cee3d35 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.134490 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c7d0-04e1-404e-9b64-c78eb548dded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.135406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c7d0-04e1-404e-9b64-c78eb548dded None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.135685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c7d0-04e1-404e-9b64-c78eb548dded None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.135956 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19c7d0-04e1-404e-9b64-c78eb548dded None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.145794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19c7d0-04e1-404e-9b64-c78eb548dded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:48.146767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1ec6-5b90-44fa-9177-847b9585d1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.147432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1ec6-5b90-44fa-9177-847b9585d1d0 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.147716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1ec6-5b90-44fa-9177-847b9585d1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.147997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed1ec6-5b90-44fa-9177-847b9585d1d0 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.148723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed1ec6-5b90-44fa-9177-847b9585d1d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:48.150217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed1ec6-5b90-44fa-9177-847b9585d1d0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-fd19c7d0-04e1-404e-9b64-c78eb548dded None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:48.153525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:48.154661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 98/194] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:48.155640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c7d0-04e1-404e-9b64-c78eb548dded None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.173960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 97/195] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:24:48 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:48.174801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1ec6-5b90-44fa-9177-847b9585d1d0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.191919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:48.282871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:48.293920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19c7d0-04e1-404e-9b64-c78eb548dded None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.296824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed1ec6-5b90-44fa-9177-847b9585d1d0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.332316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.333664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.333664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.333664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.334959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] RBAC: Adding query filter params (role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=4f96a19958aa48e2b0cedeec36b609fa, user.id=bfe3b92c2dc6441793fd4e5a64a8a280) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:48.334959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:48.335115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2497-a834-4b5e-8243-8d674234df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.335624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2497-a834-4b5e-8243-8d674234df75 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.335911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2497-a834-4b5e-8243-8d674234df75 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.337131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:48.337237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e2497-a834-4b5e-8243-8d674234df75 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.337739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e2497-a834-4b5e-8243-8d674234df75 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:48.339486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e2497-a834-4b5e-8243-8d674234df75 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:48.341121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 98/196] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:48.341990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2497-a834-4b5e-8243-8d674234df75 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.349985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 99/197] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/role_assignments?user.id=bfe3b92c2dc6441793fd4e5a64a8a280&scope.project.id=4f96a19958aa48e2b0cedeec36b609fa&role.id=1cafdd847d454019a89ce61428b4a863 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:48.349985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.455862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:48.473874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39215922-b588-4d1a-924f-6e571ecf0b5a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.479758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e2497-a834-4b5e-8243-8d674234df75 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.518899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.519620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.519904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.520185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.520955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:48.521264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:48.522716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:48.528734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.529633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.530095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.530505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.531472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:48.531947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:48.532809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 100/198] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:48.533657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.533891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:48.545229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 99/199] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:48.545405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.566131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:48.660652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462ecc3-9774-4571-83ee-c93dc4c955b6 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.671367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603841cb-d9c6-4c7e-8122-c12b6f9ef7d4 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.705332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1aa78-0eda-46fd-a432-5bcbdfe3226b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.706948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1aa78-0eda-46fd-a432-5bcbdfe3226b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.707425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1aa78-0eda-46fd-a432-5bcbdfe3226b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.707871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1aa78-0eda-46fd-a432-5bcbdfe3226b None admin] PATH_INFO: `/v3/users/07a2570fd3ce462d9987ae693a84da4b` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.709430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1aa78-0eda-46fd-a432-5bcbdfe3226b None admin] RBAC: Authorizing `identity:get_user(user_id=07a2570fd3ce462d9987ae693a84da4b)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:48.710129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.710885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.711229 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.711881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.712181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1aa78-0eda-46fd-a432-5bcbdfe3226b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:48.712855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=d7e62e4fa17345388ed4552283040e34, user.id=5d34143b2f0147a9845f3a75f9a5098d) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:48.714257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:48.714575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 100/200] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/users/07a2570fd3ce462d9987ae693a84da4b => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:48.715507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1aa78-0eda-46fd-a432-5bcbdfe3226b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.719208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:48.727279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 101/201] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/role_assignments?user.id=5d34143b2f0147a9845f3a75f9a5098d&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:48.728295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.746921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:48.908370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1aa78-0eda-46fd-a432-5bcbdfe3226b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:48.954920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:48.955110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c2364-5583-4c8f-a9b5-dfa4238bedac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:48.957281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2364-5583-4c8f-a9b5-dfa4238bedac None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:48.957281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2364-5583-4c8f-a9b5-dfa4238bedac None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:48.957281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c2364-5583-4c8f-a9b5-dfa4238bedac None admin] PATH_INFO: `/v3/users/5d34143b2f0147a9845f3a75f9a5098d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:48.958844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c2364-5583-4c8f-a9b5-dfa4238bedac None admin] RBAC: Authorizing `identity:get_user(user_id=5d34143b2f0147a9845f3a75f9a5098d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:48.960309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c2364-5583-4c8f-a9b5-dfa4238bedac None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:48.964852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 101/202] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/users/5d34143b2f0147a9845f3a75f9a5098d => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:48.970141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c2364-5583-4c8f-a9b5-dfa4238bedac None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:48.991721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e890e81-bc13-46ba-89b0-a13bdcd444bc None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:49.056854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48bb7d-7fea-4fb4-86d1-433d0d87b8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:49.057579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48bb7d-7fea-4fb4-86d1-433d0d87b8c0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:49.057859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48bb7d-7fea-4fb4-86d1-433d0d87b8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:49.058150 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48bb7d-7fea-4fb4-86d1-433d0d87b8c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:49.090309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:49.114535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c2364-5583-4c8f-a9b5-dfa4238bedac None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:49.156725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b63a1-d2e9-4eb5-871e-50aa22ba4a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:49.157381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b63a1-d2e9-4eb5-871e-50aa22ba4a9e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:49.157658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b63a1-d2e9-4eb5-871e-50aa22ba4a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:49.157933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b63a1-d2e9-4eb5-871e-50aa22ba4a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:49.223682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48bb7d-7fea-4fb4-86d1-433d0d87b8c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:49.226084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48bb7d-7fea-4fb4-86d1-433d0d87b8c0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:49.283566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b63a1-d2e9-4eb5-871e-50aa22ba4a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:49.285039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b63a1-d2e9-4eb5-871e-50aa22ba4a9e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:49.357831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:49.388629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 102/203] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:49.396565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48bb7d-7fea-4fb4-86d1-433d0d87b8c0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:49.406810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:49.445594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 102/204] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:49.454903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b63a1-d2e9-4eb5-871e-50aa22ba4a9e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:49.518721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48bb7d-7fea-4fb4-86d1-433d0d87b8c0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:49.596558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec77763-03ca-4f7d-99a4-51effdbfa218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:49.598875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77763-03ca-4f7d-99a4-51effdbfa218 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:49.599985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77763-03ca-4f7d-99a4-51effdbfa218 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:49.601142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77763-03ca-4f7d-99a4-51effdbfa218 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:49.605491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec77763-03ca-4f7d-99a4-51effdbfa218 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:49.607256 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec77763-03ca-4f7d-99a4-51effdbfa218 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:49.609541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 103/205] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:49 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:49.615713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec77763-03ca-4f7d-99a4-51effdbfa218 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:49.639052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b63a1-d2e9-4eb5-871e-50aa22ba4a9e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:49.730677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f19e6-3f3f-4a1f-8a38-4d91e27b58d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:49.731586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f19e6-3f3f-4a1f-8a38-4d91e27b58d8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:49.731868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f19e6-3f3f-4a1f-8a38-4d91e27b58d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:49.732143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f19e6-3f3f-4a1f-8a38-4d91e27b58d8 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:49.734668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f19e6-3f3f-4a1f-8a38-4d91e27b58d8 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:49.736143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f19e6-3f3f-4a1f-8a38-4d91e27b58d8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:49.738052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 103/206] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:49 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:49.738388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:49.746896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f19e6-3f3f-4a1f-8a38-4d91e27b58d8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:49.770338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec77763-03ca-4f7d-99a4-51effdbfa218 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:49.835561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040177b-d765-456b-8d77-7a324c7a3dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:49.836546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040177b-d765-456b-8d77-7a324c7a3dbd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:49.837024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040177b-d765-456b-8d77-7a324c7a3dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:49.837301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040177b-d765-456b-8d77-7a324c7a3dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:49.838270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040177b-d765-456b-8d77-7a324c7a3dbd None admin] RBAC: Adding query filter params (role.id=20aa0cf18e2b49ee859eef779cc3c45d, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29, user.id=07a2570fd3ce462d9987ae693a84da4b) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:49.838585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040177b-d765-456b-8d77-7a324c7a3dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:49.840031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040177b-d765-456b-8d77-7a324c7a3dbd None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:49.845352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:49.855018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 104/207] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:49 2022] GET /identity/v3/role_assignments?user.id=07a2570fd3ce462d9987ae693a84da4b&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=20aa0cf18e2b49ee859eef779cc3c45d => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:49.927498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f19e6-3f3f-4a1f-8a38-4d91e27b58d8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:49.970321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e37d1-9a23-4417-9766-289b749ae14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:49.971013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e37d1-9a23-4417-9766-289b749ae14f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:49.971295 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e37d1-9a23-4417-9766-289b749ae14f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:49.971571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e37d1-9a23-4417-9766-289b749ae14f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:49.972503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e37d1-9a23-4417-9766-289b749ae14f None admin] RBAC: Adding query filter params (role.id=048795d190224624ad8e995082b0faa0, scope.project.id=d7e62e4fa17345388ed4552283040e34, user.id=5d34143b2f0147a9845f3a75f9a5098d) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:49.972825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e37d1-9a23-4417-9766-289b749ae14f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:49.974364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e37d1-9a23-4417-9766-289b749ae14f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:49.981482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 104/208] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:49 2022] GET /identity/v3/role_assignments?user.id=5d34143b2f0147a9845f3a75f9a5098d&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=048795d190224624ad8e995082b0faa0 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:50.566753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd1fd4-3f23-4346-af71-5d6f1531ba14 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:50.567037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd1fd4-3f23-4346-af71-5d6f1531ba14 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:50.567555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd1fd4-3f23-4346-af71-5d6f1531ba14 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:50.569133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 105/209] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:50.574536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a565-66ba-47b8-8acd-13505121b3ba None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:50.575054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a565-66ba-47b8-8acd-13505121b3ba None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:50.575547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a565-66ba-47b8-8acd-13505121b3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:50.593460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-46f0a565-66ba-47b8-8acd-13505121b3ba None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:50.595005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-46f0a565-66ba-47b8-8acd-13505121b3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:50.670251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 105/210] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:50.693547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd1fd4-3f23-4346-af71-5d6f1531ba14 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:50.753265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee987c1-f6c2-481b-9bb2-8732b3191747 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:50.753774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee987c1-f6c2-481b-9bb2-8732b3191747 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:50.753848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee987c1-f6c2-481b-9bb2-8732b3191747 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:50.755416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 106/211] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:24:50.761566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169fa8e-99c0-4a87-aa44-56847db5b35b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:50.761850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169fa8e-99c0-4a87-aa44-56847db5b35b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:50.762154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169fa8e-99c0-4a87-aa44-56847db5b35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:50.780037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0169fa8e-99c0-4a87-aa44-56847db5b35b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:50.781896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0169fa8e-99c0-4a87-aa44-56847db5b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:50.810161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd1fd4-3f23-4346-af71-5d6f1531ba14 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:50.821180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:50.824833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:50.854478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d517e-c738-4530-8a47-f09d3eb5e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:50.855557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d517e-c738-4530-8a47-f09d3eb5e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:50.855977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d517e-c738-4530-8a47-f09d3eb5e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:50.856389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d517e-c738-4530-8a47-f09d3eb5e3e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:50.866735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 107/212] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:50.874249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d517e-c738-4530-8a47-f09d3eb5e3e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-668d517e-c738-4530-8a47-f09d3eb5e3e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:50.886785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:50.888546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:50.890206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:50.894050 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169fa8e-99c0-4a87-aa44-56847db5b35b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:50.895459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 106/213] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:50.904037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d517e-c738-4530-8a47-f09d3eb5e3e8 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:50.998976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169fa8e-99c0-4a87-aa44-56847db5b35b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.015898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d517e-c738-4530-8a47-f09d3eb5e3e8 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.038104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389608e-a256-4b7b-9ea8-df3d56a21af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.038920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389608e-a256-4b7b-9ea8-df3d56a21af3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.039205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389608e-a256-4b7b-9ea8-df3d56a21af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.039482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389608e-a256-4b7b-9ea8-df3d56a21af3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.040638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389608e-a256-4b7b-9ea8-df3d56a21af3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:51.042302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389608e-a256-4b7b-9ea8-df3d56a21af3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:51.043937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 108/214] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:51.049743 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce3fa9-d11e-434d-b6f3-a2ac3759837d None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.050055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce3fa9-d11e-434d-b6f3-a2ac3759837d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.050337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce3fa9-d11e-434d-b6f3-a2ac3759837d None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.053985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 109/215] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:51.053985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce3fa9-d11e-434d-b6f3-a2ac3759837d None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.056361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12c5c-f577-409e-b44f-84ff1dd92cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.057314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12c5c-f577-409e-b44f-84ff1dd92cda None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.058166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12c5c-f577-409e-b44f-84ff1dd92cda None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.058655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12c5c-f577-409e-b44f-84ff1dd92cda None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.060763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12c5c-f577-409e-b44f-84ff1dd92cda None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:51.060960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12c5c-f577-409e-b44f-84ff1dd92cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:51.062380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12c5c-f577-409e-b44f-84ff1dd92cda None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:51.071155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 107/216] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:51.072544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818260-fab3-4600-b0ce-8355cb9567f1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.072778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818260-fab3-4600-b0ce-8355cb9567f1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.073050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da818260-fab3-4600-b0ce-8355cb9567f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.090239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-da818260-fab3-4600-b0ce-8355cb9567f1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:51.091407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-da818260-fab3-4600-b0ce-8355cb9567f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:51.103382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:51.120842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:51.162114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 108/217] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:51.163228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818260-fab3-4600-b0ce-8355cb9567f1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.180467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce3fa9-d11e-434d-b6f3-a2ac3759837d None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.224551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cad07-9075-4ee3-80a2-7bb2f5b1b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.225329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cad07-9075-4ee3-80a2-7bb2f5b1b4de None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.225735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cad07-9075-4ee3-80a2-7bb2f5b1b4de None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.226046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cad07-9075-4ee3-80a2-7bb2f5b1b4de None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.226777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cad07-9075-4ee3-80a2-7bb2f5b1b4de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:51.228235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cad07-9075-4ee3-80a2-7bb2f5b1b4de None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:51.249573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 110/218] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:24:51 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:51.250384 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cad07-9075-4ee3-80a2-7bb2f5b1b4de None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.274746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da818260-fab3-4600-b0ce-8355cb9567f1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.313984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76e10-d6f2-4489-917c-31f8795eead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.314880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76e10-d6f2-4489-917c-31f8795eead1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.315168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76e10-d6f2-4489-917c-31f8795eead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.315440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76e10-d6f2-4489-917c-31f8795eead1 None admin] PATH_INFO: `/v3/users/647f03883890404686f3993544e4b8e5` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.332363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76e10-d6f2-4489-917c-31f8795eead1 None admin] RBAC: Authorizing `identity:get_user(user_id=647f03883890404686f3993544e4b8e5)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:51.333885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76e10-d6f2-4489-917c-31f8795eead1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:51.335893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 109/219] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:51 2022] GET /identity/v3/users/647f03883890404686f3993544e4b8e5 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:51.341798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76e10-d6f2-4489-917c-31f8795eead1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.360555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:51.367408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cad07-9075-4ee3-80a2-7bb2f5b1b4de None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.382556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:51.406416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09133df-b1d4-462b-9d57-fa51586ac32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.407231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09133df-b1d4-462b-9d57-fa51586ac32f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.407515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09133df-b1d4-462b-9d57-fa51586ac32f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.407788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09133df-b1d4-462b-9d57-fa51586ac32f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.419222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09133df-b1d4-462b-9d57-fa51586ac32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-e09133df-b1d4-462b-9d57-fa51586ac32f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:51.432214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:51.433284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:51.434109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 111/220] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:51.440870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09133df-b1d4-462b-9d57-fa51586ac32f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.474278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76e10-d6f2-4489-917c-31f8795eead1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.517855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86286c-6651-42b2-b066-2552e04c9b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.519048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86286c-6651-42b2-b066-2552e04c9b3c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.519222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86286c-6651-42b2-b066-2552e04c9b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.519595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86286c-6651-42b2-b066-2552e04c9b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.560228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09133df-b1d4-462b-9d57-fa51586ac32f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.606932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.607538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.607822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.608171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.608856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:51.609163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:51.610773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:51.613971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86286c-6651-42b2-b066-2552e04c9b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:51.615593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86286c-6651-42b2-b066-2552e04c9b3c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:51.620767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 112/221] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:51.626077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.643024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:51.650339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:51.738884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 110/222] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:51.747064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86286c-6651-42b2-b066-2552e04c9b3c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.758595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb31b3b-143f-4a0e-bce4-98052b6e7be0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.795201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1af14a-bc56-4a2b-8325-c94dbc3e2ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.796136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1af14a-bc56-4a2b-8325-c94dbc3e2ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.796416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1af14a-bc56-4a2b-8325-c94dbc3e2ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.796722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1af14a-bc56-4a2b-8325-c94dbc3e2ab4 None admin] PATH_INFO: `/v3/users/5d34143b2f0147a9845f3a75f9a5098d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.797931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1af14a-bc56-4a2b-8325-c94dbc3e2ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=5d34143b2f0147a9845f3a75f9a5098d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:51.800421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1af14a-bc56-4a2b-8325-c94dbc3e2ab4 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:51.802436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 113/223] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:51 2022] GET /identity/v3/users/5d34143b2f0147a9845f3a75f9a5098d => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:51.808680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1af14a-bc56-4a2b-8325-c94dbc3e2ab4 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.911578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86286c-6651-42b2-b066-2552e04c9b3c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:51.936401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:51.953975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6b225-6d34-484a-b13c-fa1c72317794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:51.954873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b225-6d34-484a-b13c-fa1c72317794 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:51.955153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b225-6d34-484a-b13c-fa1c72317794 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:51.955429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf6b225-6d34-484a-b13c-fa1c72317794 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:51.956776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6b225-6d34-484a-b13c-fa1c72317794 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:51.958266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf6b225-6d34-484a-b13c-fa1c72317794 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:51.967684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 111/224] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:51 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:51.968603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6b225-6d34-484a-b13c-fa1c72317794 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:51.989613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:52.007155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1af14a-bc56-4a2b-8325-c94dbc3e2ab4 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:52.049937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df6238-3754-40a8-ac07-54c553b70f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:52.052466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df6238-3754-40a8-ac07-54c553b70f73 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:52.053145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df6238-3754-40a8-ac07-54c553b70f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:52.054221 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df6238-3754-40a8-ac07-54c553b70f73 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:52.056456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df6238-3754-40a8-ac07-54c553b70f73 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:52.059541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df6238-3754-40a8-ac07-54c553b70f73 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:52.061764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 114/225] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:51 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:52.067639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df6238-3754-40a8-ac07-54c553b70f73 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:52.185495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf6b225-6d34-484a-b13c-fa1c72317794 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:52.226564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621fac9-313c-4e1e-bb05-42a1e1e7cb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:52.227551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621fac9-313c-4e1e-bb05-42a1e1e7cb86 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:52.227848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621fac9-313c-4e1e-bb05-42a1e1e7cb86 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:52.228391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621fac9-313c-4e1e-bb05-42a1e1e7cb86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:52.229374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621fac9-313c-4e1e-bb05-42a1e1e7cb86 None admin] RBAC: Adding query filter params (role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=d7e62e4fa17345388ed4552283040e34, user.id=647f03883890404686f3993544e4b8e5) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:52.229697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621fac9-313c-4e1e-bb05-42a1e1e7cb86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:52.230137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df6238-3754-40a8-ac07-54c553b70f73 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:52.231188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621fac9-313c-4e1e-bb05-42a1e1e7cb86 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:52.238616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 112/226] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:51 2022] GET /identity/v3/role_assignments?user.id=647f03883890404686f3993544e4b8e5&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=1cafdd847d454019a89ce61428b4a863 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:52.240380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fa8e4-b73a-4b37-b4a5-4a126cfc9e4f None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:52.240672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fa8e4-b73a-4b37-b4a5-4a126cfc9e4f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:52.240954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fa8e4-b73a-4b37-b4a5-4a126cfc9e4f None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:52.242954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 113/227] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:52.248830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b13a-ad58-4f64-8f41-17624f5aab7e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:52.249117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b13a-ad58-4f64-8f41-17624f5aab7e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:52.249402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b13a-ad58-4f64-8f41-17624f5aab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:52.267224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2fd0b13a-ad58-4f64-8f41-17624f5aab7e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:52.268452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2fd0b13a-ad58-4f64-8f41-17624f5aab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:52.270217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f417a-a843-4f3d-989c-b2edd5bf934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:52.271488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f417a-a843-4f3d-989c-b2edd5bf934f None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:52.271914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f417a-a843-4f3d-989c-b2edd5bf934f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:52.272309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f417a-a843-4f3d-989c-b2edd5bf934f None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34/users/5d34143b2f0147a9845f3a75f9a5098d/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:52.274623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f417a-a843-4f3d-989c-b2edd5bf934f None admin] RBAC: Authorizing `identity:create_grant(project_id=d7e62e4fa17345388ed4552283040e34, user_id=5d34143b2f0147a9845f3a75f9a5098d, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:52.276380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f417a-a843-4f3d-989c-b2edd5bf934f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:52.300753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 115/228] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:52 2022] PUT /identity/v3/projects/d7e62e4fa17345388ed4552283040e34/users/5d34143b2f0147a9845f3a75f9a5098d/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:52.358460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:52.386456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 114/229] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:52.425494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f417a-a843-4f3d-989c-b2edd5bf934f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:52.453455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:52.561350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f417a-a843-4f3d-989c-b2edd5bf934f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:52.597075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5e1f9-a629-4bcb-abf4-107498ed05e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:52.597894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e1f9-a629-4bcb-abf4-107498ed05e7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:52.598208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e1f9-a629-4bcb-abf4-107498ed05e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:52.598484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5e1f9-a629-4bcb-abf4-107498ed05e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:52.609070 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5e1f9-a629-4bcb-abf4-107498ed05e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-a1b5e1f9-a629-4bcb-abf4-107498ed05e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:52.617506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:52.618441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:52.619291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 116/230] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:24:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:52.625515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b13a-ad58-4f64-8f41-17624f5aab7e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:52.752725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b13a-ad58-4f64-8f41-17624f5aab7e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:52.804570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:52.805251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:52.805536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:52.805818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:52.806613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:52.806988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:52.808373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:52.821054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 115/231] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:24:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:52.826800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5e1f9-a629-4bcb-abf4-107498ed05e7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:52.923783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:52.961654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5e1f9-a629-4bcb-abf4-107498ed05e7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:53.002858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4040c-3265-40dc-b39c-1197045df8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:53.003658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4040c-3265-40dc-b39c-1197045df8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:53.003931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4040c-3265-40dc-b39c-1197045df8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:53.004207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4040c-3265-40dc-b39c-1197045df8b4 None admin] PATH_INFO: `/v3/users/5d34143b2f0147a9845f3a75f9a5098d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:53.005393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4040c-3265-40dc-b39c-1197045df8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=5d34143b2f0147a9845f3a75f9a5098d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:53.006889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4040c-3265-40dc-b39c-1197045df8b4 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:53.014399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 117/232] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:52 2022] GET /identity/v3/users/5d34143b2f0147a9845f3a75f9a5098d => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:53.023095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:53.119671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:53.184460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da220c51-7fae-4139-a7b1-15ccafd82b22 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:53.219929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a95d59-14ca-42be-86a2-18679af33277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:53.220800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95d59-14ca-42be-86a2-18679af33277 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:53.221073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95d59-14ca-42be-86a2-18679af33277 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:53.221344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a95d59-14ca-42be-86a2-18679af33277 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:53.222562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a95d59-14ca-42be-86a2-18679af33277 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:53.224015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a95d59-14ca-42be-86a2-18679af33277 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:53.226129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 116/233] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:53 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:53.235007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4040c-3265-40dc-b39c-1197045df8b4 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:53.364535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4040c-3265-40dc-b39c-1197045df8b4 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:53.406097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1c574-a527-4bf7-b0d6-f913ef1d7d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:53.406994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c574-a527-4bf7-b0d6-f913ef1d7d34 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:53.407275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c574-a527-4bf7-b0d6-f913ef1d7d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:53.407553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1c574-a527-4bf7-b0d6-f913ef1d7d34 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34/users/5d34143b2f0147a9845f3a75f9a5098d/roles/048795d190224624ad8e995082b0faa0` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:53.409751 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1c574-a527-4bf7-b0d6-f913ef1d7d34 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7e62e4fa17345388ed4552283040e34, user_id=5d34143b2f0147a9845f3a75f9a5098d, role_id=048795d190224624ad8e995082b0faa0)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:53.411248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1c574-a527-4bf7-b0d6-f913ef1d7d34 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:53.435367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:53.440211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 118/234] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:53 2022] PUT /identity/v3/projects/d7e62e4fa17345388ed4552283040e34/users/5d34143b2f0147a9845f3a75f9a5098d/roles/048795d190224624ad8e995082b0faa0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:53.702940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c270c-7b27-4248-8016-489e18191b63 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:53.703329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c270c-7b27-4248-8016-489e18191b63 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:53.703529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c270c-7b27-4248-8016-489e18191b63 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:53.704884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 117/235] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:53.710606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b52d-11a1-457b-b08f-dbae85e0afb7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:53.710903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b52d-11a1-457b-b08f-dbae85e0afb7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:53.711488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0b52d-11a1-457b-b08f-dbae85e0afb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:53.729032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-03d0b52d-11a1-457b-b08f-dbae85e0afb7 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:53.730273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-03d0b52d-11a1-457b-b08f-dbae85e0afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:53.799873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 119/236] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:53.824034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c270c-7b27-4248-8016-489e18191b63 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:53.935395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c270c-7b27-4248-8016-489e18191b63 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:53.951864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:53.969997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc99e17-d830-4ebd-8a37-860209591811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:53.970729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99e17-d830-4ebd-8a37-860209591811 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:53.971423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99e17-d830-4ebd-8a37-860209591811 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:53.971704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc99e17-d830-4ebd-8a37-860209591811 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:53.982971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc99e17-d830-4ebd-8a37-860209591811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-ffc99e17-d830-4ebd-8a37-860209591811 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:53.991036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:53.991926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:53.992697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 118/237] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:53.998283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0b52d-11a1-457b-b08f-dbae85e0afb7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:54.136370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0b52d-11a1-457b-b08f-dbae85e0afb7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:54.165359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:54.172852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:54.173540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.173830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.174165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.178826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:54.179146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:54.180632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:54.183535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234c76-6162-40e3-8d46-d7819e09a3d8 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.183820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234c76-6162-40e3-8d46-d7819e09a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.184096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86234c76-6162-40e3-8d46-d7819e09a3d8 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.185530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 119/238] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:54.190094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 120/239] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:54.191325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3b7c-3b66-471a-ac87-3b8462030ee8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.191611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3b7c-3b66-471a-ac87-3b8462030ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.191944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb3b7c-3b66-471a-ac87-3b8462030ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.195355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:54.223518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-85fb3b7c-3b66-471a-ac87-3b8462030ee8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:54.224676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-85fb3b7c-3b66-471a-ac87-3b8462030ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:54.292457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 120/240] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:54.346584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb3b7c-3b66-471a-ac87-3b8462030ee8 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:54.384793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32988790-3db6-4021-9f66-6202ca82acc1 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:54.447515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb3b7c-3b66-471a-ac87-3b8462030ee8 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:54.462281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:54.475362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c1fc-e0e5-40b8-94f1-5c94ae608307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:54.476194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c1fc-e0e5-40b8-94f1-5c94ae608307 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.476476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c1fc-e0e5-40b8-94f1-5c94ae608307 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.476754 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c1fc-e0e5-40b8-94f1-5c94ae608307 None admin] PATH_INFO: `/v3/users/5f94fb2b847c4d90bb8947536ccc118f` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.482894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251a05-74be-4b7b-b957-731632c96eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:54.483895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251a05-74be-4b7b-b957-731632c96eba None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.484240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251a05-74be-4b7b-b957-731632c96eba None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.484583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251a05-74be-4b7b-b957-731632c96eba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.485865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251a05-74be-4b7b-b957-731632c96eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:54.487547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251a05-74be-4b7b-b957-731632c96eba None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:54.489596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 121/241] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:54.498409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251a05-74be-4b7b-b957-731632c96eba None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:54.515526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c1fc-e0e5-40b8-94f1-5c94ae608307 None admin] RBAC: Authorizing `identity:get_user(user_id=5f94fb2b847c4d90bb8947536ccc118f)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:54.517023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c1fc-e0e5-40b8-94f1-5c94ae608307 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:54.519220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 121/242] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:54 2022] GET /identity/v3/users/5f94fb2b847c4d90bb8947536ccc118f => generated 297 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:54.524551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c1fc-e0e5-40b8-94f1-5c94ae608307 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:54.598960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251a05-74be-4b7b-b957-731632c96eba None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:54.633378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f617132-7c51-433a-9227-6ea64db275e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:54.634174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617132-7c51-433a-9227-6ea64db275e7 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.634523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617132-7c51-433a-9227-6ea64db275e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.634942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f617132-7c51-433a-9227-6ea64db275e7 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.635764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f617132-7c51-433a-9227-6ea64db275e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:54.637293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f617132-7c51-433a-9227-6ea64db275e7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:54.657757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:54.662955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 122/243] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:24:54 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:24:54.664454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322ec0a-fc38-42c1-8124-cf52721f5173 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.665077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322ec0a-fc38-42c1-8124-cf52721f5173 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.665425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322ec0a-fc38-42c1-8124-cf52721f5173 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.667225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 123/244] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:54.673313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a379-1897-470d-8620-83fc8e04cce3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.673644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a379-1897-470d-8620-83fc8e04cce3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.673860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3a379-1897-470d-8620-83fc8e04cce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.690928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-06d3a379-1897-470d-8620-83fc8e04cce3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:54.692182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-06d3a379-1897-470d-8620-83fc8e04cce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:54.718899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:54.727058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c1fc-e0e5-40b8-94f1-5c94ae608307 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:54.766255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 124/245] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:54.772482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f6f76-43e7-459b-b116-1248761579d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:54.773399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f6f76-43e7-459b-b116-1248761579d2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.773879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f6f76-43e7-459b-b116-1248761579d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.774424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f6f76-43e7-459b-b116-1248761579d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.792068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a379-1897-470d-8620-83fc8e04cce3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:54.856080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f6f76-43e7-459b-b116-1248761579d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:54.858109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f6f76-43e7-459b-b116-1248761579d2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:54.895750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3a379-1897-470d-8620-83fc8e04cce3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:54.928498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:54.933276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6769-53d6-4ca4-b495-469b054818c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:54.934505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6769-53d6-4ca4-b495-469b054818c8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:54.934505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6769-53d6-4ca4-b495-469b054818c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:54.934697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6769-53d6-4ca4-b495-469b054818c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:54.947015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6769-53d6-4ca4-b495-469b054818c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-065c6769-53d6-4ca4-b495-469b054818c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:54.955364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:54.956316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:54.957108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 125/246] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:24:54.962971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6769-53d6-4ca4-b495-469b054818c8 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:54.992523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:54.997469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 122/247] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:24:55.003656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f6f76-43e7-459b-b116-1248761579d2 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:55.080283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6769-53d6-4ca4-b495-469b054818c8 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:55.114630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f6f76-43e7-459b-b116-1248761579d2 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:55.117632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c059c86-facc-455f-9ddf-cfdd038bf75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:55.118402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c059c86-facc-455f-9ddf-cfdd038bf75c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.118680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c059c86-facc-455f-9ddf-cfdd038bf75c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.119006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c059c86-facc-455f-9ddf-cfdd038bf75c None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.119850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c059c86-facc-455f-9ddf-cfdd038bf75c None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:55.120160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c059c86-facc-455f-9ddf-cfdd038bf75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:55.121555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c059c86-facc-455f-9ddf-cfdd038bf75c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:55.135639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 126/248] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:55.137115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eecb35-003f-473d-af0c-ad3825025bfb None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.137402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eecb35-003f-473d-af0c-ad3825025bfb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.141468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eecb35-003f-473d-af0c-ad3825025bfb None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.141468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 127/249] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:55.141468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eecb35-003f-473d-af0c-ad3825025bfb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:55.159828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba00b79-bfe5-4eb3-bc1d-d0de76b51e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:55.160708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba00b79-bfe5-4eb3-bc1d-d0de76b51e4f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.161355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba00b79-bfe5-4eb3-bc1d-d0de76b51e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.161355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba00b79-bfe5-4eb3-bc1d-d0de76b51e4f None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.162738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba00b79-bfe5-4eb3-bc1d-d0de76b51e4f None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:55.164226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba00b79-bfe5-4eb3-bc1d-d0de76b51e4f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:55.166522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 123/250] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:55 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:55.167837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e603d-953f-4100-bfd6-ba07b51a4090 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.168044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e603d-953f-4100-bfd6-ba07b51a4090 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.168321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e603d-953f-4100-bfd6-ba07b51a4090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.185924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-666e603d-953f-4100-bfd6-ba07b51a4090 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:55.187152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-666e603d-953f-4100-bfd6-ba07b51a4090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:55.204166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:55.245823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:55.271018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 124/251] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:55.271383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eecb35-003f-473d-af0c-ad3825025bfb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:55.271869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e603d-953f-4100-bfd6-ba07b51a4090 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:55.327223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e53d8-245c-4cc1-9dbd-28454326354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:55.328103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e53d8-245c-4cc1-9dbd-28454326354f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.328388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e53d8-245c-4cc1-9dbd-28454326354f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.328665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e53d8-245c-4cc1-9dbd-28454326354f None admin] PATH_INFO: `/v3/users/647f03883890404686f3993544e4b8e5` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.329887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e53d8-245c-4cc1-9dbd-28454326354f None admin] RBAC: Authorizing `identity:get_user(user_id=647f03883890404686f3993544e4b8e5)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:55.331482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e53d8-245c-4cc1-9dbd-28454326354f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:55.333303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 128/252] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:55 2022] GET /identity/v3/users/647f03883890404686f3993544e4b8e5 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:55.333884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e53d8-245c-4cc1-9dbd-28454326354f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:55.391390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e603d-953f-4100-bfd6-ba07b51a4090 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:55.432280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:55.432947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.433228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.433503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.434374 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] RBAC: Adding query filter params (role.id=20aa0cf18e2b49ee859eef779cc3c45d, scope.project.id=d7e62e4fa17345388ed4552283040e34, user.id=5f94fb2b847c4d90bb8947536ccc118f) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:55.434689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:55.436158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:55.444195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 125/253] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:55 2022] GET /identity/v3/role_assignments?user.id=5f94fb2b847c4d90bb8947536ccc118f&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=20aa0cf18e2b49ee859eef779cc3c45d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:55.445024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:55.461437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:55.469392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e53d8-245c-4cc1-9dbd-28454326354f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:55.538578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05288-7130-4938-961a-b923c3b0ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:55.538578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05288-7130-4938-961a-b923c3b0ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.538578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05288-7130-4938-961a-b923c3b0ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.538578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05288-7130-4938-961a-b923c3b0ae60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.555486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b05288-7130-4938-961a-b923c3b0ae60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-e2b05288-7130-4938-961a-b923c3b0ae60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:55.568684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:55.569616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:55.570877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 129/254] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:24:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:55.575927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05288-7130-4938-961a-b923c3b0ae60 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:55.599250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:55.650013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c26d2d-0919-4b15-bbd6-9546a423c38c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:55.700170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f27f51-960f-450d-9dca-7a6ce036f9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:55.701061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f27f51-960f-450d-9dca-7a6ce036f9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.701345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f27f51-960f-450d-9dca-7a6ce036f9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.701615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f27f51-960f-450d-9dca-7a6ce036f9e0 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.707188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f27f51-960f-450d-9dca-7a6ce036f9e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:55.708941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f27f51-960f-450d-9dca-7a6ce036f9e0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:55.710976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 126/255] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:55 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:55.717571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f27f51-960f-450d-9dca-7a6ce036f9e0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:55.808970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05288-7130-4938-961a-b923c3b0ae60 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:55.815324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:55.838867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f27f51-960f-450d-9dca-7a6ce036f9e0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:55.887244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:55.888207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673dbf-8bd7-417c-a3c4-e6b987d7e985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:55.888497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.888961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.889082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673dbf-8bd7-417c-a3c4-e6b987d7e985 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:55.889363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673dbf-8bd7-417c-a3c4-e6b987d7e985 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:55.889635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673dbf-8bd7-417c-a3c4-e6b987d7e985 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34/users/647f03883890404686f3993544e4b8e5/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.889932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:55.890891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:55.891395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:55.891613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce673dbf-8bd7-417c-a3c4-e6b987d7e985 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7e62e4fa17345388ed4552283040e34, user_id=647f03883890404686f3993544e4b8e5, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:55.893062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce673dbf-8bd7-417c-a3c4-e6b987d7e985 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:55.893335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:55.909703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 130/256] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:55.915186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:55.928770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 127/257] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:55 2022] PUT /identity/v3/projects/d7e62e4fa17345388ed4552283040e34/users/647f03883890404686f3993544e4b8e5/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:24:56.036805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:56.117028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe2af4-f6a4-42bc-ae06-803b193feda6 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:56.163940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43ff2f-faa1-4de1-b0b3-e9f2b114a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:56.164889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ff2f-faa1-4de1-b0b3-e9f2b114a302 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:56.165174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ff2f-faa1-4de1-b0b3-e9f2b114a302 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:56.165452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43ff2f-faa1-4de1-b0b3-e9f2b114a302 None admin] PATH_INFO: `/v3/users/5d34143b2f0147a9845f3a75f9a5098d` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:56.166794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43ff2f-faa1-4de1-b0b3-e9f2b114a302 None admin] RBAC: Authorizing `identity:get_user(user_id=5d34143b2f0147a9845f3a75f9a5098d)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:56.168251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43ff2f-faa1-4de1-b0b3-e9f2b114a302 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:56.169891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 131/258] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:55 2022] GET /identity/v3/users/5d34143b2f0147a9845f3a75f9a5098d => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:56.175801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673dbf-8bd7-417c-a3c4-e6b987d7e985 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:56.235665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4ca9f-ef4f-4647-a155-d91932c9cd7e None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:56.235972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4ca9f-ef4f-4647-a155-d91932c9cd7e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:56.236254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4ca9f-ef4f-4647-a155-d91932c9cd7e None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:56.238123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 132/259] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:56.243031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a52ef-1b2c-4a6c-bfd8-c4f92b3ae85a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:56.243311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a52ef-1b2c-4a6c-bfd8-c4f92b3ae85a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:56.243584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a52ef-1b2c-4a6c-bfd8-c4f92b3ae85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:56.261510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-933a52ef-1b2c-4a6c-bfd8-c4f92b3ae85a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:56.263161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-933a52ef-1b2c-4a6c-bfd8-c4f92b3ae85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:56.333858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 133/260] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:56.357614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a52ef-1b2c-4a6c-bfd8-c4f92b3ae85a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:56.360252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673dbf-8bd7-417c-a3c4-e6b987d7e985 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:56.428885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:56.445933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1fbbe-fe54-4dd0-bd20-eecf9e880eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:56.446679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fbbe-fe54-4dd0-bd20-eecf9e880eef None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:56.446965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fbbe-fe54-4dd0-bd20-eecf9e880eef None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:56.447251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1fbbe-fe54-4dd0-bd20-eecf9e880eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:56.463097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a52ef-1b2c-4a6c-bfd8-c4f92b3ae85a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:56.470327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:56.498374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a8953-c0a8-44cc-bbe6-46d7a980dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:56.499533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8953-c0a8-44cc-bbe6-46d7a980dab8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:56.500028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8953-c0a8-44cc-bbe6-46d7a980dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:56.500494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a8953-c0a8-44cc-bbe6-46d7a980dab8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:56.511476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a8953-c0a8-44cc-bbe6-46d7a980dab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-cc6a8953-c0a8-44cc-bbe6-46d7a980dab8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:56.521409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:56.522308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:24:56.523190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:56.525741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 134/261] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:24:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:24:56.536288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a8953-c0a8-44cc-bbe6-46d7a980dab8 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:56.602511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1fbbe-fe54-4dd0-bd20-eecf9e880eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:56.603993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1fbbe-fe54-4dd0-bd20-eecf9e880eef None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:56.701675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a8953-c0a8-44cc-bbe6-46d7a980dab8 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:56.757788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:56.768945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:56.769890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:56.770438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:56.770974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:56.772913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:56.773425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:56.775182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:56.796294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 135/262] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:24:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:56.797505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:56.802081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 128/263] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:24:56.823859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1fbbe-fe54-4dd0-bd20-eecf9e880eef None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:56.894251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:57.001660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee4498-842c-48fe-b440-4a10745e6f4d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:57.011018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1fbbe-fe54-4dd0-bd20-eecf9e880eef None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:57.040550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d20466-b96f-4f1f-a5b3-07a58f847614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:57.042616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20466-b96f-4f1f-a5b3-07a58f847614 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:57.048812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20466-b96f-4f1f-a5b3-07a58f847614 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:57.051710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20466-b96f-4f1f-a5b3-07a58f847614 None admin] PATH_INFO: `/v3/users/5d34143b2f0147a9845f3a75f9a5098d` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:57.053332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d20466-b96f-4f1f-a5b3-07a58f847614 None admin] RBAC: Authorizing `identity:get_user(user_id=5d34143b2f0147a9845f3a75f9a5098d)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:57.055062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d20466-b96f-4f1f-a5b3-07a58f847614 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:57.065463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 136/264] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:56 2022] GET /identity/v3/users/5d34143b2f0147a9845f3a75f9a5098d => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:57.073144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d20466-b96f-4f1f-a5b3-07a58f847614 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:57.098848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c47c85-3896-4696-a374-b5b4fd53c667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:57.100097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c47c85-3896-4696-a374-b5b4fd53c667 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:57.102570 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c47c85-3896-4696-a374-b5b4fd53c667 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:57.103108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c47c85-3896-4696-a374-b5b4fd53c667 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:57.105611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c47c85-3896-4696-a374-b5b4fd53c667 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:57.110626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c47c85-3896-4696-a374-b5b4fd53c667 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:57.118322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 129/265] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:56 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:57.125148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c47c85-3896-4696-a374-b5b4fd53c667 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:57.182374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:57.240702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d20466-b96f-4f1f-a5b3-07a58f847614 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:57.292124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a752f-d6eb-4c31-9422-e8afca951c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:57.293650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a752f-d6eb-4c31-9422-e8afca951c44 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:57.294312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a752f-d6eb-4c31-9422-e8afca951c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:57.297006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a752f-d6eb-4c31-9422-e8afca951c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:57.368344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c47c85-3896-4696-a374-b5b4fd53c667 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:57.385048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:57.422433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a752f-d6eb-4c31-9422-e8afca951c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:57.423916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a752f-d6eb-4c31-9422-e8afca951c44 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:57.434354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:57.434946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:57.435230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:57.435506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:57.436350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=d7e62e4fa17345388ed4552283040e34, user.id=5d34143b2f0147a9845f3a75f9a5098d) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:57.436662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:57.438135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:57.456380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 130/266] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:57 2022] GET /identity/v3/role_assignments?user.id=5d34143b2f0147a9845f3a75f9a5098d&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:57.531135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:57.568496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 137/267] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:24:57.574290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:57.690796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a706998-27a5-4f91-923a-40d3bfdb15f6 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:57.736884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea8221-60dc-4154-bf1b-68f9d0177a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:57.737774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8221-60dc-4154-bf1b-68f9d0177a64 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:57.738086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8221-60dc-4154-bf1b-68f9d0177a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:57.738366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8221-60dc-4154-bf1b-68f9d0177a64 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:57.739590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea8221-60dc-4154-bf1b-68f9d0177a64 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:57.741067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea8221-60dc-4154-bf1b-68f9d0177a64 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:57.743119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 131/268] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:57 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:57.749001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a752f-d6eb-4c31-9422-e8afca951c44 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:57.862649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a752f-d6eb-4c31-9422-e8afca951c44 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:57.896960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0dbed-cb1f-4fdf-bd02-08d9c485e985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:57.897624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0dbed-cb1f-4fdf-bd02-08d9c485e985 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:57.897906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0dbed-cb1f-4fdf-bd02-08d9c485e985 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:57.898207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0dbed-cb1f-4fdf-bd02-08d9c485e985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:57.899055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0dbed-cb1f-4fdf-bd02-08d9c485e985 None admin] RBAC: Adding query filter params (role.id=048795d190224624ad8e995082b0faa0, scope.project.id=d7e62e4fa17345388ed4552283040e34, user.id=5d34143b2f0147a9845f3a75f9a5098d) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:57.899368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0dbed-cb1f-4fdf-bd02-08d9c485e985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:57.900864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0dbed-cb1f-4fdf-bd02-08d9c485e985 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:57.907479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 138/269] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:24:57 2022] GET /identity/v3/role_assignments?user.id=5d34143b2f0147a9845f3a75f9a5098d&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=048795d190224624ad8e995082b0faa0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:58.131328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a23d65-9e59-4959-9e06-a1c253a97afc None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.131652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a23d65-9e59-4959-9e06-a1c253a97afc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.131895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a23d65-9e59-4959-9e06-a1c253a97afc None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.133461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 132/270] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:58.139790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390db5-2203-461c-9958-4d3b75faabd8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.140250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390db5-2203-461c-9958-4d3b75faabd8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.140322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32390db5-2203-461c-9958-4d3b75faabd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.165750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-32390db5-2203-461c-9958-4d3b75faabd8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:58.167008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-32390db5-2203-461c-9958-4d3b75faabd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:58.185491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af519-e239-425f-887a-1c201aef74e7 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.185791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af519-e239-425f-887a-1c201aef74e7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.186070 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6af519-e239-425f-887a-1c201aef74e7 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.187478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 133/271] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:24:58.193969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a6b3-d7cb-4310-968b-908b80d9dfee None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.194297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a6b3-d7cb-4310-968b-908b80d9dfee None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.194533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796a6b3-d7cb-4310-968b-908b80d9dfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.205765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:58.222180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-4796a6b3-d7cb-4310-968b-908b80d9dfee None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:58.223776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4796a6b3-d7cb-4310-968b-908b80d9dfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:58.265087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:58.283889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 139/272] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:58.287335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5509-e187-4e72-9809-556b58e5926c None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.287852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5509-e187-4e72-9809-556b58e5926c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.288138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5509-e187-4e72-9809-556b58e5926c None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.289833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 140/273] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:58.294909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd229-e86e-4b62-995a-245781840c85 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.295370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd229-e86e-4b62-995a-245781840c85 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.295771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efd229-e86e-4b62-995a-245781840c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.305399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 134/274] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:58.318078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796a6b3-d7cb-4310-968b-908b80d9dfee None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.318395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-17efd229-e86e-4b62-995a-245781840c85 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:58.319700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-17efd229-e86e-4b62-995a-245781840c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:58.389638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 141/275] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:24:58.390777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efd229-e86e-4b62-995a-245781840c85 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.429151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796a6b3-d7cb-4310-968b-908b80d9dfee None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.463533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f06412-44aa-410c-a89f-139feb81bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.464341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06412-44aa-410c-a89f-139feb81bc50 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.464623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06412-44aa-410c-a89f-139feb81bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.464899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f06412-44aa-410c-a89f-139feb81bc50 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.475868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f06412-44aa-410c-a89f-139feb81bc50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-73f06412-44aa-410c-a89f-139feb81bc50 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:58.483730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:58.484577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:58.485406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 135/276] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:24:58.486720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f06412-44aa-410c-a89f-139feb81bc50 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.487144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:58.508287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efd229-e86e-4b62-995a-245781840c85 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.521788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:58.542167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff278e-3ce3-4c62-a020-b5d4f3ff4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.542966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff278e-3ce3-4c62-a020-b5d4f3ff4bcf None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.543254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff278e-3ce3-4c62-a020-b5d4f3ff4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.543755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff278e-3ce3-4c62-a020-b5d4f3ff4bcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.544701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff278e-3ce3-4c62-a020-b5d4f3ff4bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:58.546175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff278e-3ce3-4c62-a020-b5d4f3ff4bcf None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:58.547868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 142/277] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:58.548658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff278e-3ce3-4c62-a020-b5d4f3ff4bcf None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.600185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f06412-44aa-410c-a89f-139feb81bc50 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.634853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a41a99-2677-44bf-82a3-a7afcd72eb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.635655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41a99-2677-44bf-82a3-a7afcd72eb01 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.635934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41a99-2677-44bf-82a3-a7afcd72eb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.636201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41a99-2677-44bf-82a3-a7afcd72eb01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.646302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a41a99-2677-44bf-82a3-a7afcd72eb01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-e9a41a99-2677-44bf-82a3-a7afcd72eb01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:58.654239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:58.655319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:24:58.656145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 136/278] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:58.656824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a41a99-2677-44bf-82a3-a7afcd72eb01 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.662412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff278e-3ce3-4c62-a020-b5d4f3ff4bcf None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.698389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.698787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.699067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.699339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.700085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:58.700623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:58.701760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:58.710003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 143/279] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:58.715548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.732576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:58.751651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:58.762834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a41a99-2677-44bf-82a3-a7afcd72eb01 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.804364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bb5f8-6cdc-497a-97e7-cada04681520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.805149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb5f8-6cdc-497a-97e7-cada04681520 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.805426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb5f8-6cdc-497a-97e7-cada04681520 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.805708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bb5f8-6cdc-497a-97e7-cada04681520 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.806459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bb5f8-6cdc-497a-97e7-cada04681520 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:58.807995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458bb5f8-6cdc-497a-97e7-cada04681520 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:58.822729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd701abe-7af6-4907-90da-24d42b8b6ca1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:58.830613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 137/280] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:24:58 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:24:58.831331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bb5f8-6cdc-497a-97e7-cada04681520 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.880572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:58.882132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:58.882942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:58.883468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:58.884834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:58.885903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:58.887884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:58.901746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 144/281] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:58.907202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:58.958236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bb5f8-6cdc-497a-97e7-cada04681520 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:59.000749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e982bf-8251-4b05-8ef7-55a58ff7698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:59.003043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e982bf-8251-4b05-8ef7-55a58ff7698c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.003043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e982bf-8251-4b05-8ef7-55a58ff7698c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.003043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e982bf-8251-4b05-8ef7-55a58ff7698c None admin] PATH_INFO: `/v3/users/5f94fb2b847c4d90bb8947536ccc118f` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.004371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e982bf-8251-4b05-8ef7-55a58ff7698c None admin] RBAC: Authorizing `identity:get_user(user_id=5f94fb2b847c4d90bb8947536ccc118f)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:59.005846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e982bf-8251-4b05-8ef7-55a58ff7698c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:59.007868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 138/282] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/users/5f94fb2b847c4d90bb8947536ccc118f => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:59.011121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:59.013903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e982bf-8251-4b05-8ef7-55a58ff7698c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:59.036807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:59.041850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42231ef-3c59-4f87-8e65-08a19a810e64 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:59.084785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80faa6-926f-45f3-8efc-583d7c6c52ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:59.085685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80faa6-926f-45f3-8efc-583d7c6c52ea None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.086030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80faa6-926f-45f3-8efc-583d7c6c52ea None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.086595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80faa6-926f-45f3-8efc-583d7c6c52ea None admin] PATH_INFO: `/v3/users/4a67aa86658841739d2b4a787deb19fb` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.103943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80faa6-926f-45f3-8efc-583d7c6c52ea None admin] RBAC: Authorizing `identity:get_user(user_id=4a67aa86658841739d2b4a787deb19fb)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:59.105678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80faa6-926f-45f3-8efc-583d7c6c52ea None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:59.108858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 145/283] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:58 2022] GET /identity/v3/users/4a67aa86658841739d2b4a787deb19fb => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:59.113105 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80faa6-926f-45f3-8efc-583d7c6c52ea None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:59.163361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e982bf-8251-4b05-8ef7-55a58ff7698c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:59.212482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b454de-beca-4423-95da-b7d82bb6c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:59.213185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b454de-beca-4423-95da-b7d82bb6c961 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.213464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b454de-beca-4423-95da-b7d82bb6c961 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.213737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b454de-beca-4423-95da-b7d82bb6c961 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.215450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b454de-beca-4423-95da-b7d82bb6c961 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:59.217482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b454de-beca-4423-95da-b7d82bb6c961 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:59.221985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 139/284] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:24:59 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:59.221985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cb483-8055-4b73-9ff5-f6e13935ead2 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.221985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cb483-8055-4b73-9ff5-f6e13935ead2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.221985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cb483-8055-4b73-9ff5-f6e13935ead2 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.222739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 140/285] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:24:59.227220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cb483-8055-4b73-9ff5-f6e13935ead2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:59.243371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80faa6-926f-45f3-8efc-583d7c6c52ea None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:59.289437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eed38-cb36-4c39-be08-e9d1f6e40488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:59.290630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eed38-cb36-4c39-be08-e9d1f6e40488 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.291278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eed38-cb36-4c39-be08-e9d1f6e40488 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.291760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eed38-cb36-4c39-be08-e9d1f6e40488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.293469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eed38-cb36-4c39-be08-e9d1f6e40488 None admin] RBAC: Adding query filter params (role.id=1cafdd847d454019a89ce61428b4a863, user.id=4a67aa86658841739d2b4a787deb19fb, scope.system=all) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:59.294195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eed38-cb36-4c39-be08-e9d1f6e40488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:59.296810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eed38-cb36-4c39-be08-e9d1f6e40488 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:59.302247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:59.309605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 146/286] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jul 1 19:24:59 2022] GET /identity/v3/role_assignments?user.id=4a67aa86658841739d2b4a787deb19fb&scope.system=all&role.id=1cafdd847d454019a89ce61428b4a863 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:24:59.309605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8af81-0d35-4244-a519-554ac05e651b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.309605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8af81-0d35-4244-a519-554ac05e651b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.309605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8af81-0d35-4244-a519-554ac05e651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.341539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c3b8af81-0d35-4244-a519-554ac05e651b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:24:59.342788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c3b8af81-0d35-4244-a519-554ac05e651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:24:59.354848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:59.426779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cb483-8055-4b73-9ff5-f6e13935ead2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:59.436675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 147/287] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:24:59.476136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8af81-0d35-4244-a519-554ac05e651b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:59.509219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470542-d248-414b-9709-18ec4ec26967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:59.510261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470542-d248-414b-9709-18ec4ec26967 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.510541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470542-d248-414b-9709-18ec4ec26967 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.510812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470542-d248-414b-9709-18ec4ec26967 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34/users/5f94fb2b847c4d90bb8947536ccc118f/roles/20aa0cf18e2b49ee859eef779cc3c45d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.512883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470542-d248-414b-9709-18ec4ec26967 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7e62e4fa17345388ed4552283040e34, user_id=5f94fb2b847c4d90bb8947536ccc118f, role_id=20aa0cf18e2b49ee859eef779cc3c45d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:59.514422 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6470542-d248-414b-9709-18ec4ec26967 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:59.533159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 141/288] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:24:59 2022] PUT /identity/v3/projects/d7e62e4fa17345388ed4552283040e34/users/5f94fb2b847c4d90bb8947536ccc118f/roles/20aa0cf18e2b49ee859eef779cc3c45d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:24:59.633985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8af81-0d35-4244-a519-554ac05e651b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:59.672097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:24:59.684130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d5cf7-915c-4d7e-9134-a28e7c16a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:59.684869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d5cf7-915c-4d7e-9134-a28e7c16a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.685153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d5cf7-915c-4d7e-9134-a28e7c16a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.685432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d5cf7-915c-4d7e-9134-a28e7c16a6d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.703043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d5cf7-915c-4d7e-9134-a28e7c16a6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-ec1d5cf7-915c-4d7e-9134-a28e7c16a6d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:24:59.711018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:24:59.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:24:59.713099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 148/289] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:24:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:24:59.720523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470542-d248-414b-9709-18ec4ec26967 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:24:59.830164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470542-d248-414b-9709-18ec4ec26967 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:24:59.865111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:24:59.865788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:24:59.866091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:24:59.866366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:24:59.867121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:24:59.867421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:24:59.868796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:24:59.878218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 142/290] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:24:59.887071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d5cf7-915c-4d7e-9134-a28e7c16a6d7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:00.029195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d5cf7-915c-4d7e-9134-a28e7c16a6d7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:00.083530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e4e4-7653-4f61-983c-52da2eb30423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:00.084411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e4e4-7653-4f61-983c-52da2eb30423 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:00.084698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e4e4-7653-4f61-983c-52da2eb30423 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:00.084977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e4e4-7653-4f61-983c-52da2eb30423 None admin] PATH_INFO: `/v3/users/647f03883890404686f3993544e4b8e5` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:00.086562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3e4e4-7653-4f61-983c-52da2eb30423 None admin] RBAC: Authorizing `identity:get_user(user_id=647f03883890404686f3993544e4b8e5)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:00.088056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3e4e4-7653-4f61-983c-52da2eb30423 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:00.089692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 149/291] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:24:59 2022] GET /identity/v3/users/647f03883890404686f3993544e4b8e5 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:00.095372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:00.103429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:00.220006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55886a5-9da5-4947-938f-ba21e1fdb4e7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:00.262946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f6869-0b15-4c52-8a95-14f3b709f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:00.263641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6869-0b15-4c52-8a95-14f3b709f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:00.263923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6869-0b15-4c52-8a95-14f3b709f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:00.264196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f6869-0b15-4c52-8a95-14f3b709f7c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:00.341059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f6869-0b15-4c52-8a95-14f3b709f7c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:00.342500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f6869-0b15-4c52-8a95-14f3b709f7c1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:00.345263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:00.441636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 143/292] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:00.446899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e4e4-7653-4f61-983c-52da2eb30423 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:00.529556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:00.585062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e4e4-7653-4f61-983c-52da2eb30423 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:00.628671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25acec-7455-40bc-ab85-5eed9ee19c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:00.629456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25acec-7455-40bc-ab85-5eed9ee19c12 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:00.629736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25acec-7455-40bc-ab85-5eed9ee19c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:00.630033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25acec-7455-40bc-ab85-5eed9ee19c12 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:00.634730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25acec-7455-40bc-ab85-5eed9ee19c12 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:00.636180 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25acec-7455-40bc-ab85-5eed9ee19c12 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:00.638213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 150/293] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:00 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:00.643998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f6869-0b15-4c52-8a95-14f3b709f7c1 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:00.771490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f6869-0b15-4c52-8a95-14f3b709f7c1 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:00.778672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:00.806575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600be2e-5f2e-4040-8486-95a49c654663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:00.807239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600be2e-5f2e-4040-8486-95a49c654663 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:00.807516 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600be2e-5f2e-4040-8486-95a49c654663 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:00.807787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600be2e-5f2e-4040-8486-95a49c654663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:00.808613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600be2e-5f2e-4040-8486-95a49c654663 None admin] RBAC: Adding query filter params (role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=d7e62e4fa17345388ed4552283040e34, user.id=647f03883890404686f3993544e4b8e5) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:00.808917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600be2e-5f2e-4040-8486-95a49c654663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:00.810389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600be2e-5f2e-4040-8486-95a49c654663 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:00.817052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 144/294] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:00 2022] GET /identity/v3/role_assignments?user.id=647f03883890404686f3993544e4b8e5&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=1cafdd847d454019a89ce61428b4a863 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:01.342565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf9629-d447-4afc-8c9f-8548f428b0b5 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.343228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf9629-d447-4afc-8c9f-8548f428b0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.343729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf9629-d447-4afc-8c9f-8548f428b0b5 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.345569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 151/295] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:01.350998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaeecb-60ab-4fd0-a8f6-662701b697b1 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.351521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaeecb-60ab-4fd0-a8f6-662701b697b1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.352012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaeecb-60ab-4fd0-a8f6-662701b697b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.369926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8fdaeecb-60ab-4fd0-a8f6-662701b697b1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:01.371450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8fdaeecb-60ab-4fd0-a8f6-662701b697b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:01.401441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064039-1b00-4001-94a8-44d1d64cc6cf None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.401760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064039-1b00-4001-94a8-44d1d64cc6cf None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.402036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f064039-1b00-4001-94a8-44d1d64cc6cf None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.403532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 152/296] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:01.408352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4bdb6-6831-4cfc-affd-ee13fe8c9cb8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.408639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4bdb6-6831-4cfc-affd-ee13fe8c9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.408918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4bdb6-6831-4cfc-affd-ee13fe8c9cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.433822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-82a4bdb6-6831-4cfc-affd-ee13fe8c9cb8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:01.436005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-82a4bdb6-6831-4cfc-affd-ee13fe8c9cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:01.455328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 145/297] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:01.479171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaeecb-60ab-4fd0-a8f6-662701b697b1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.522112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 153/298] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:01.545822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4bdb6-6831-4cfc-affd-ee13fe8c9cb8 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.583700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:01.588354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaeecb-60ab-4fd0-a8f6-662701b697b1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:01.604137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:01.635542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d880-a173-4655-9b43-1a5e94ef2242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:01.637046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d880-a173-4655-9b43-1a5e94ef2242 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.637927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d880-a173-4655-9b43-1a5e94ef2242 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.638418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d880-a173-4655-9b43-1a5e94ef2242 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.639843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313d880-a173-4655-9b43-1a5e94ef2242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:01.642384 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313d880-a173-4655-9b43-1a5e94ef2242 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:01.650040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 146/299] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:01.651240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d880-a173-4655-9b43-1a5e94ef2242 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.660216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4bdb6-6831-4cfc-affd-ee13fe8c9cb8 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:01.702745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103214e-45c7-4226-8481-fd5a7d133396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:01.704380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103214e-45c7-4226-8481-fd5a7d133396 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.704860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103214e-45c7-4226-8481-fd5a7d133396 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.705779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103214e-45c7-4226-8481-fd5a7d133396 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.722179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103214e-45c7-4226-8481-fd5a7d133396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-8103214e-45c7-4226-8481-fd5a7d133396 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:01.733891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:01.734813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:25:01.735621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:01.739526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 154/300] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:01.749251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103214e-45c7-4226-8481-fd5a7d133396 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.778968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d880-a173-4655-9b43-1a5e94ef2242 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:01.825906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98451c-fd2d-4185-914a-3cd0f9716afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:01.826682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98451c-fd2d-4185-914a-3cd0f9716afb None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.827023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98451c-fd2d-4185-914a-3cd0f9716afb None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.827351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98451c-fd2d-4185-914a-3cd0f9716afb None admin] PATH_INFO: `/v3/groups` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.828202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98451c-fd2d-4185-914a-3cd0f9716afb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:01.829684 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98451c-fd2d-4185-914a-3cd0f9716afb None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:01.858142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 147/301] 10.222.0.61 () {60 vars in 1134 bytes} [Fri Jul 1 19:25:01 2022] POST /identity/v3/groups => generated 229 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:01.889174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103214e-45c7-4226-8481-fd5a7d133396 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:01.905192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:01.931065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c7dc4-53ab-4fb7-96dd-83a6d247b6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:01.931805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c7dc4-53ab-4fb7-96dd-83a6d247b6de None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.932088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c7dc4-53ab-4fb7-96dd-83a6d247b6de None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.932366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c7dc4-53ab-4fb7-96dd-83a6d247b6de None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.933141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c7dc4-53ab-4fb7-96dd-83a6d247b6de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:01.933451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c7dc4-53ab-4fb7-96dd-83a6d247b6de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:01.934895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c7dc4-53ab-4fb7-96dd-83a6d247b6de None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:01.944932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 155/302] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:01.952438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98451c-fd2d-4185-914a-3cd0f9716afb None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:01.962095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c839-2296-4e6d-bc63-bcfd7f5308bf None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.962412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c839-2296-4e6d-bc63-bcfd7f5308bf None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.962663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c839-2296-4e6d-bc63-bcfd7f5308bf None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.964333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 156/303] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:01.970368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0cb9e-d262-4797-acdb-38214125d810 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:01.970682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0cb9e-d262-4797-acdb-38214125d810 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:01.970919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0cb9e-d262-4797-acdb-38214125d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:01.989537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-64b0cb9e-d262-4797-acdb-38214125d810 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:01.990852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-64b0cb9e-d262-4797-acdb-38214125d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:01.993605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.079023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 157/304] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:02.092732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb461b-41b8-44f3-85aa-0beea9c7a141 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.093034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb461b-41b8-44f3-85aa-0beea9c7a141 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.093284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb461b-41b8-44f3-85aa-0beea9c7a141 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.094732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 158/305] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:02.099634 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865851-837a-4e55-ab36-24bf5c45c329 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.099779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98451c-fd2d-4185-914a-3cd0f9716afb None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.099971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865851-837a-4e55-ab36-24bf5c45c329 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.100200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e865851-837a-4e55-ab36-24bf5c45c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.119111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6e865851-837a-4e55-ab36-24bf5c45c329 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:02.120216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6e865851-837a-4e55-ab36-24bf5c45c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:02.137888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97028a-51d2-4ca6-971c-1ab826d38d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.138856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97028a-51d2-4ca6-971c-1ab826d38d7f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.139136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97028a-51d2-4ca6-971c-1ab826d38d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.139413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97028a-51d2-4ca6-971c-1ab826d38d7f None admin] PATH_INFO: `/v3/users/9bb528cfa7194b16b1186ebf7cda955c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.153768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97028a-51d2-4ca6-971c-1ab826d38d7f None admin] RBAC: Authorizing `identity:get_user(user_id=9bb528cfa7194b16b1186ebf7cda955c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.155255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97028a-51d2-4ca6-971c-1ab826d38d7f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.157330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 148/306] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:25:01 2022] GET /identity/v3/users/9bb528cfa7194b16b1186ebf7cda955c => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:02.158194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97028a-51d2-4ca6-971c-1ab826d38d7f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.206411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 159/307] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:02.206411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e865851-837a-4e55-ab36-24bf5c45c329 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.252008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.261729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.279755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97028a-51d2-4ca6-971c-1ab826d38d7f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.319027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ae808-ac5d-4462-ac2f-2eb40263aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.319832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae808-ac5d-4462-ac2f-2eb40263aa6e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.320114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae808-ac5d-4462-ac2f-2eb40263aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.320388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ae808-ac5d-4462-ac2f-2eb40263aa6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.328996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e865851-837a-4e55-ab36-24bf5c45c329 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.331924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ae808-ac5d-4462-ac2f-2eb40263aa6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ef3ae808-ac5d-4462-ac2f-2eb40263aa6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:02.340874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:02.341913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:02.342927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 149/308] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:02.343860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ae808-ac5d-4462-ac2f-2eb40263aa6e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.370200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.370746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.371031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.371466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.372141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] RBAC: Adding query filter params (role.id=20aa0cf18e2b49ee859eef779cc3c45d, user.id=9bb528cfa7194b16b1186ebf7cda955c, scope.system=all) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:02.372454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.373889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.379602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 160/309] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/role_assignments?user.id=9bb528cfa7194b16b1186ebf7cda955c&scope.system=all&role.id=20aa0cf18e2b49ee859eef779cc3c45d => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:02.382894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.479348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ae808-ac5d-4462-ac2f-2eb40263aa6e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.507127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.512835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4470a9-82a3-45fa-a054-3448c34d8b50 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.529458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596904b-cfcb-4077-8407-8097965c7b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.530973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596904b-cfcb-4077-8407-8097965c7b23 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.531261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596904b-cfcb-4077-8407-8097965c7b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.531540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596904b-cfcb-4077-8407-8097965c7b23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.546444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596904b-cfcb-4077-8407-8097965c7b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-6596904b-cfcb-4077-8407-8097965c7b23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:02.555763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:02.556737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:25:02.557522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:02.561586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.562078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 150/310] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:02.562157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.562157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.562157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.562157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:02.562157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.562157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.563862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596904b-cfcb-4077-8407-8097965c7b23 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.569369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.571615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 161/311] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:02.578406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.678089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596904b-cfcb-4077-8407-8097965c7b23 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.696074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4bee7-741d-4ef6-9ad8-bc5f9b93937f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.715287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.715978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.716261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.716537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.717820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:02.718163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.719566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.733982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 151/312] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:02.737298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.739709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f4fb1-8aa0-4006-a0ae-e43d93651492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.740595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f4fb1-8aa0-4006-a0ae-e43d93651492 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.740877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f4fb1-8aa0-4006-a0ae-e43d93651492 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.741153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f4fb1-8aa0-4006-a0ae-e43d93651492 None admin] PATH_INFO: `/v3/users/4a67aa86658841739d2b4a787deb19fb` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.742648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f4fb1-8aa0-4006-a0ae-e43d93651492 None admin] RBAC: Authorizing `identity:get_user(user_id=4a67aa86658841739d2b4a787deb19fb)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.743814 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f4fb1-8aa0-4006-a0ae-e43d93651492 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.745987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 162/313] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/users/4a67aa86658841739d2b4a787deb19fb => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:02.751129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f4fb1-8aa0-4006-a0ae-e43d93651492 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:02.783534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.828996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:02.861171 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f4fb1-8aa0-4006-a0ae-e43d93651492 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.873774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021faa2a-844f-451a-89e9-b2333b1fde79 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:02.896370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7e3eb-4c34-4990-b280-26bbdcd6737e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.897631 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e3eb-4c34-4990-b280-26bbdcd6737e None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.898127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e3eb-4c34-4990-b280-26bbdcd6737e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.898577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7e3eb-4c34-4990-b280-26bbdcd6737e None admin] PATH_INFO: `/v3/system/users/4a67aa86658841739d2b4a787deb19fb/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.900404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7e3eb-4c34-4990-b280-26bbdcd6737e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4a67aa86658841739d2b4a787deb19fb, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.902034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7e3eb-4c34-4990-b280-26bbdcd6737e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.918490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778bdf4-78d0-4f14-9522-2d3566898a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:02.918490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778bdf4-78d0-4f14-9522-2d3566898a07 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:02.918490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778bdf4-78d0-4f14-9522-2d3566898a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:02.918490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778bdf4-78d0-4f14-9522-2d3566898a07 None admin] PATH_INFO: `/v3/users/5f94fb2b847c4d90bb8947536ccc118f` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:02.918895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778bdf4-78d0-4f14-9522-2d3566898a07 None admin] RBAC: Authorizing `identity:get_user(user_id=5f94fb2b847c4d90bb8947536ccc118f)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:02.919260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778bdf4-78d0-4f14-9522-2d3566898a07 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:02.919440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 163/314] 10.222.0.61 () {58 vars in 1334 bytes} [Fri Jul 1 19:25:02 2022] PUT /identity/v3/system/users/4a67aa86658841739d2b4a787deb19fb/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:02.921220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 152/315] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/users/5f94fb2b847c4d90bb8947536ccc118f => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:02.928583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7e3eb-4c34-4990-b280-26bbdcd6737e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:03.047777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:03.056733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7e3eb-4c34-4990-b280-26bbdcd6737e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:03.097084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fb6d-83e8-4508-96a8-f7d6f36405b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:03.097749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fb6d-83e8-4508-96a8-f7d6f36405b0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:03.098064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fb6d-83e8-4508-96a8-f7d6f36405b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:03.098347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3fb6d-83e8-4508-96a8-f7d6f36405b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:03.208339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3fb6d-83e8-4508-96a8-f7d6f36405b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:03.210817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3fb6d-83e8-4508-96a8-f7d6f36405b0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:03.369376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:03.384182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 164/316] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:03.391915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778bdf4-78d0-4f14-9522-2d3566898a07 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:03.575173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778bdf4-78d0-4f14-9522-2d3566898a07 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:03.634876 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc84b0-fdd7-4ccb-80bd-3a3d7068a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:03.636809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc84b0-fdd7-4ccb-80bd-3a3d7068a135 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:03.637578 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc84b0-fdd7-4ccb-80bd-3a3d7068a135 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:03.638351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc84b0-fdd7-4ccb-80bd-3a3d7068a135 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:03.640581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc84b0-fdd7-4ccb-80bd-3a3d7068a135 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:03.643495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc84b0-fdd7-4ccb-80bd-3a3d7068a135 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:03.647194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 153/317] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:03 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:03.659082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fb6d-83e8-4508-96a8-f7d6f36405b0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:03.759041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3fb6d-83e8-4508-96a8-f7d6f36405b0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:03.794640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efdfba-7f7c-48e9-8c8b-f52ac7725208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:03.795292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efdfba-7f7c-48e9-8c8b-f52ac7725208 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:03.795573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efdfba-7f7c-48e9-8c8b-f52ac7725208 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:03.795851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efdfba-7f7c-48e9-8c8b-f52ac7725208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:03.796687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efdfba-7f7c-48e9-8c8b-f52ac7725208 None admin] RBAC: Adding query filter params (role.id=20aa0cf18e2b49ee859eef779cc3c45d, scope.project.id=d7e62e4fa17345388ed4552283040e34, user.id=5f94fb2b847c4d90bb8947536ccc118f) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:03.796997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efdfba-7f7c-48e9-8c8b-f52ac7725208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:03.798468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efdfba-7f7c-48e9-8c8b-f52ac7725208 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:03.804701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 165/318] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:03 2022] GET /identity/v3/role_assignments?user.id=5f94fb2b847c4d90bb8947536ccc118f&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=20aa0cf18e2b49ee859eef779cc3c45d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:04.002584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff621ca-79d0-48bf-9b9a-58aaedecfb50 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:04.003109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff621ca-79d0-48bf-9b9a-58aaedecfb50 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:04.003109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff621ca-79d0-48bf-9b9a-58aaedecfb50 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:04.004843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 154/319] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:04.010287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085adbd-3593-4745-8b11-feae9a94583d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:04.010849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085adbd-3593-4745-8b11-feae9a94583d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:04.011330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085adbd-3593-4745-8b11-feae9a94583d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:04.029693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-5085adbd-3593-4745-8b11-feae9a94583d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:04.030896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5085adbd-3593-4745-8b11-feae9a94583d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:04.089597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:04.106028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 166/320] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:04.126751 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff621ca-79d0-48bf-9b9a-58aaedecfb50 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:04.129988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:04.235855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff621ca-79d0-48bf-9b9a-58aaedecfb50 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:04.270720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118fd6d-b710-4c3f-aeb0-6c61994cc14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:04.271405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118fd6d-b710-4c3f-aeb0-6c61994cc14e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:04.271676 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118fd6d-b710-4c3f-aeb0-6c61994cc14e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:04.271938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118fd6d-b710-4c3f-aeb0-6c61994cc14e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:04.273080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118fd6d-b710-4c3f-aeb0-6c61994cc14e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:04.274802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118fd6d-b710-4c3f-aeb0-6c61994cc14e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:04.277193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 155/321] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:04.282809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085adbd-3593-4745-8b11-feae9a94583d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:04.385106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085adbd-3593-4745-8b11-feae9a94583d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:04.418435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43494e31-d0bd-4659-b1a3-c4f8581259c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:04.419092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43494e31-d0bd-4659-b1a3-c4f8581259c5 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:04.419370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43494e31-d0bd-4659-b1a3-c4f8581259c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:04.419646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43494e31-d0bd-4659-b1a3-c4f8581259c5 None admin] PATH_INFO: `/v3/groups` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:04.420343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43494e31-d0bd-4659-b1a3-c4f8581259c5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:04.421769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43494e31-d0bd-4659-b1a3-c4f8581259c5 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:04.437198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 167/322] 10.222.0.61 () {60 vars in 1134 bytes} [Fri Jul 1 19:25:04 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:25:04.451993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf02c-98bc-496e-ad64-78637cf2933e None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:04.452316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf02c-98bc-496e-ad64-78637cf2933e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:04.452577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadf02c-98bc-496e-ad64-78637cf2933e None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:04.454188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 156/323] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:04.460132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c86740-9bbe-4fc4-b13f-b7566ce3f037 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:04.460458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c86740-9bbe-4fc4-b13f-b7566ce3f037 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:04.460688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c86740-9bbe-4fc4-b13f-b7566ce3f037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:04.479255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-70c86740-9bbe-4fc4-b13f-b7566ce3f037 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:04.480467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-70c86740-9bbe-4fc4-b13f-b7566ce3f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:04.530865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:04.557803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 168/324] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:04.581216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf02c-98bc-496e-ad64-78637cf2933e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:04.659287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:04.695795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadf02c-98bc-496e-ad64-78637cf2933e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:04.733643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383496b0-ba25-4927-910b-34962454bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:04.734767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383496b0-ba25-4927-910b-34962454bced None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:04.735217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383496b0-ba25-4927-910b-34962454bced None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:04.735628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383496b0-ba25-4927-910b-34962454bced None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:04.748143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383496b0-ba25-4927-910b-34962454bced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-383496b0-ba25-4927-910b-34962454bced None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:04.755682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:04.756554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:04.757835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 157/325] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:04.763032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c86740-9bbe-4fc4-b13f-b7566ce3f037 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:04.875811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c86740-9bbe-4fc4-b13f-b7566ce3f037 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:04.913299 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8949-add0-4782-95d0-20713557c331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:04.914023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8949-add0-4782-95d0-20713557c331 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:04.914304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8949-add0-4782-95d0-20713557c331 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:04.914581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed8949-add0-4782-95d0-20713557c331 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:04.915358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8949-add0-4782-95d0-20713557c331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:04.915666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8949-add0-4782-95d0-20713557c331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:04.917122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed8949-add0-4782-95d0-20713557c331 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:04.926536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 169/326] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:04.931683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383496b0-ba25-4927-910b-34962454bced None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:05.048437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383496b0-ba25-4927-910b-34962454bced None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:05.083155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:05.095746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998e6c3-adb7-4c8d-a4a1-2add012046e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:05.096892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e6c3-adb7-4c8d-a4a1-2add012046e2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:05.097309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e6c3-adb7-4c8d-a4a1-2add012046e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:05.097713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e6c3-adb7-4c8d-a4a1-2add012046e2 None admin] PATH_INFO: `/v3/users/9bb528cfa7194b16b1186ebf7cda955c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:05.100581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998e6c3-adb7-4c8d-a4a1-2add012046e2 None admin] RBAC: Authorizing `identity:get_user(user_id=9bb528cfa7194b16b1186ebf7cda955c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:05.102237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998e6c3-adb7-4c8d-a4a1-2add012046e2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:05.104644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 158/327] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:25:04 2022] GET /identity/v3/users/9bb528cfa7194b16b1186ebf7cda955c => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:05.110105 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8949-add0-4782-95d0-20713557c331 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:05.164908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:05.229246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed8949-add0-4782-95d0-20713557c331 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:05.264836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a28f-776a-4e3f-b4e2-6ed9ae049204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:05.266131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a28f-776a-4e3f-b4e2-6ed9ae049204 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:05.266614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a28f-776a-4e3f-b4e2-6ed9ae049204 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:05.267086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a28f-776a-4e3f-b4e2-6ed9ae049204 None admin] PATH_INFO: `/v3/system/users/9bb528cfa7194b16b1186ebf7cda955c/roles/20aa0cf18e2b49ee859eef779cc3c45d` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:05.268812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a28f-776a-4e3f-b4e2-6ed9ae049204 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9bb528cfa7194b16b1186ebf7cda955c, role_id=20aa0cf18e2b49ee859eef779cc3c45d)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:05.270468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a28f-776a-4e3f-b4e2-6ed9ae049204 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:05.288371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 170/328] 10.222.0.61 () {58 vars in 1334 bytes} [Fri Jul 1 19:25:05 2022] PUT /identity/v3/system/users/9bb528cfa7194b16b1186ebf7cda955c/roles/20aa0cf18e2b49ee859eef779cc3c45d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:05.306793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6426e-f92d-4c33-8b09-0811a0d26ed5 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:05.307185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6426e-f92d-4c33-8b09-0811a0d26ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:05.307380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6426e-f92d-4c33-8b09-0811a0d26ed5 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:05.309192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 159/329] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:05.314979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edf29-0092-46a5-a2b5-9c77d8c56039 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:05.315320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edf29-0092-46a5-a2b5-9c77d8c56039 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:05.315538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edf29-0092-46a5-a2b5-9c77d8c56039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:05.336816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e23edf29-0092-46a5-a2b5-9c77d8c56039 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:05.338494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e23edf29-0092-46a5-a2b5-9c77d8c56039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:05.416385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 171/330] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:05.442020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6426e-f92d-4c33-8b09-0811a0d26ed5 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:05.556271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6426e-f92d-4c33-8b09-0811a0d26ed5 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:05.592329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13844163-05e2-411d-8293-b1c9e08b1b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:05.593475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13844163-05e2-411d-8293-b1c9e08b1b14 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:05.593999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13844163-05e2-411d-8293-b1c9e08b1b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:05.594470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13844163-05e2-411d-8293-b1c9e08b1b14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:05.605852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13844163-05e2-411d-8293-b1c9e08b1b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-13844163-05e2-411d-8293-b1c9e08b1b14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:05.615511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:05.616470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:05.617296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:05.619980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 160/331] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:05.627356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23edf29-0092-46a5-a2b5-9c77d8c56039 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:05.663253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:05.739482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23edf29-0092-46a5-a2b5-9c77d8c56039 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:05.777268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:05.778040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:05.778248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:05.778530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:05.779289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:05.779597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:05.780969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:05.792964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 172/332] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:05.798556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13844163-05e2-411d-8293-b1c9e08b1b14 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:05.865597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:05.918499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13844163-05e2-411d-8293-b1c9e08b1b14 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:05.961598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d69b3f-c9fe-4a6d-a455-126d7504d54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:05.962511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d69b3f-c9fe-4a6d-a455-126d7504d54c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:05.962826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d69b3f-c9fe-4a6d-a455-126d7504d54c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:05.963116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d69b3f-c9fe-4a6d-a455-126d7504d54c None admin] PATH_INFO: `/v3/users/4a67aa86658841739d2b4a787deb19fb` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:05.964329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d69b3f-c9fe-4a6d-a455-126d7504d54c None admin] RBAC: Authorizing `identity:get_user(user_id=4a67aa86658841739d2b4a787deb19fb)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:05.965821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d69b3f-c9fe-4a6d-a455-126d7504d54c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:05.967825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 161/333] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:25:05 2022] GET /identity/v3/users/4a67aa86658841739d2b4a787deb19fb => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:05.973564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:06.092860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:06.098738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4232262-2e83-4656-bddf-a406347b46ab None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:06.142641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7ce65-8ef4-4b31-928c-eb6ae9b1869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:06.143305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ce65-8ef4-4b31-928c-eb6ae9b1869f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:06.143590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ce65-8ef4-4b31-928c-eb6ae9b1869f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:06.143867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7ce65-8ef4-4b31-928c-eb6ae9b1869f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:06.144712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7ce65-8ef4-4b31-928c-eb6ae9b1869f None admin] RBAC: Adding query filter params (role.id=1cafdd847d454019a89ce61428b4a863, user.id=4a67aa86658841739d2b4a787deb19fb, scope.system=all) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:06.145026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7ce65-8ef4-4b31-928c-eb6ae9b1869f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:06.146501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7ce65-8ef4-4b31-928c-eb6ae9b1869f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:06.165543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 173/334] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jul 1 19:25:05 2022] GET /identity/v3/role_assignments?user.id=4a67aa86658841739d2b4a787deb19fb&scope.system=all&role.id=1cafdd847d454019a89ce61428b4a863 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:07.105176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3376f-75c2-40a3-b8be-732e1ff62d98 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.106174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3376f-75c2-40a3-b8be-732e1ff62d98 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.106675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3376f-75c2-40a3-b8be-732e1ff62d98 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.108484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 162/335] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:07.114089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53555860-082c-4074-a847-21050d8b98bd None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.114925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53555860-082c-4074-a847-21050d8b98bd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.115420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53555860-082c-4074-a847-21050d8b98bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.135803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-53555860-082c-4074-a847-21050d8b98bd None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:07.136978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-53555860-082c-4074-a847-21050d8b98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:07.228552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 174/336] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:07.268352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3376f-75c2-40a3-b8be-732e1ff62d98 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.406827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3376f-75c2-40a3-b8be-732e1ff62d98 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.443163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:07.452902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744270cd-40fe-4a16-a39c-42560d7bde58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.453740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744270cd-40fe-4a16-a39c-42560d7bde58 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.454050 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744270cd-40fe-4a16-a39c-42560d7bde58 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.454328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744270cd-40fe-4a16-a39c-42560d7bde58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.470474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744270cd-40fe-4a16-a39c-42560d7bde58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-744270cd-40fe-4a16-a39c-42560d7bde58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:07.478967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:07.479833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:07.480610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 163/337] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:07.481235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942082d6-915e-47a4-a8d5-e78ce324f46f None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.481235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942082d6-915e-47a4-a8d5-e78ce324f46f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.481361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942082d6-915e-47a4-a8d5-e78ce324f46f None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.483003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 175/338] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:07.486051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744270cd-40fe-4a16-a39c-42560d7bde58 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.496010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c75e77-6df2-42a2-a3eb-9e5841837403 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.496602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c75e77-6df2-42a2-a3eb-9e5841837403 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.497166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c75e77-6df2-42a2-a3eb-9e5841837403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.524049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-87c75e77-6df2-42a2-a3eb-9e5841837403 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:07.526170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-87c75e77-6df2-42a2-a3eb-9e5841837403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:07.665863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744270cd-40fe-4a16-a39c-42560d7bde58 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.668569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 176/339] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:07.704414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c75e77-6df2-42a2-a3eb-9e5841837403 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.729582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.730293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.730580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.730856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.731616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:07.731925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:07.733326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:07.736335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:07.749478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 164/340] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:07.755478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.834673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:07.853539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c75e77-6df2-42a2-a3eb-9e5841837403 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.906720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d81b-2dc3-4fed-9b4d-64cd8f6858a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.907544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d81b-2dc3-4fed-9b4d-64cd8f6858a4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.907832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d81b-2dc3-4fed-9b4d-64cd8f6858a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.908113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4d81b-2dc3-4fed-9b4d-64cd8f6858a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:07.923121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4d81b-2dc3-4fed-9b4d-64cd8f6858a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:07.932154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84163a2d-01df-4f99-8111-54d08625301a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-93e4d81b-2dc3-4fed-9b4d-64cd8f6858a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:07.938906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:07.939807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:07.940580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 177/341] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:07.949970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d81b-2dc3-4fed-9b4d-64cd8f6858a4 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:07.995675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4b2e-0d2a-4b30-81ba-0426a36c99ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:07.996748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4b2e-0d2a-4b30-81ba-0426a36c99ac None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:07.997249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4b2e-0d2a-4b30-81ba-0426a36c99ac None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:07.997719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4b2e-0d2a-4b30-81ba-0426a36c99ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.070335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:08.115610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4d81b-2dc3-4fed-9b4d-64cd8f6858a4 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:08.168190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f4b2e-0d2a-4b30-81ba-0426a36c99ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:08.169665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f4b2e-0d2a-4b30-81ba-0426a36c99ac None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:08.171212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:08.171893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.172176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.172451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.173267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:08.173517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:08.174942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:08.188204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 178/342] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:08.195539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:08.309323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:08.339833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9e2f-48f2-4461-99d1-7a85166b8da9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:08.406733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cb06a-d734-4824-b28f-82ae8243bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:08.407390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb06a-d734-4824-b28f-82ae8243bb02 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.407667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb06a-d734-4824-b28f-82ae8243bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.407937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb06a-d734-4824-b28f-82ae8243bb02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.418497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:08.438377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 165/343] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:25:08.440408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4b2e-0d2a-4b30-81ba-0426a36c99ac None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:08.540308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb06a-d734-4824-b28f-82ae8243bb02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:08.542453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb06a-d734-4824-b28f-82ae8243bb02 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:08.569275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4b2e-0d2a-4b30-81ba-0426a36c99ac None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:08.627226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87df115-bf53-4f58-b83a-6a1949f7d194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:08.628346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df115-bf53-4f58-b83a-6a1949f7d194 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.628770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df115-bf53-4f58-b83a-6a1949f7d194 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.629180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87df115-bf53-4f58-b83a-6a1949f7d194 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.634886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87df115-bf53-4f58-b83a-6a1949f7d194 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:08.636631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87df115-bf53-4f58-b83a-6a1949f7d194 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:08.638951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 166/344] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:08 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:08.640416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64c78-54c4-4141-a589-64f9631faf61 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.640838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64c78-54c4-4141-a589-64f9631faf61 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.641261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a64c78-54c4-4141-a589-64f9631faf61 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.642670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 167/345] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:08.644878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64c78-54c4-4141-a589-64f9631faf61 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:08.664478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 179/346] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:08.667621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d728f7-6f49-454e-8234-4765e2659405 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.668326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d728f7-6f49-454e-8234-4765e2659405 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.668873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d728f7-6f49-454e-8234-4765e2659405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.676348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:08.689179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e5d728f7-6f49-454e-8234-4765e2659405 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:08.690790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e5d728f7-6f49-454e-8234-4765e2659405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:08.723561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:08.766980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 180/347] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:08.768273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d728f7-6f49-454e-8234-4765e2659405 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:08.798928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a64c78-54c4-4141-a589-64f9631faf61 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:08.844272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9071429-9873-494d-bf89-f418a219c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:08.845378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9071429-9873-494d-bf89-f418a219c125 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.845825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9071429-9873-494d-bf89-f418a219c125 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.846257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9071429-9873-494d-bf89-f418a219c125 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.855237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9071429-9873-494d-bf89-f418a219c125 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:08.856919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9071429-9873-494d-bf89-f418a219c125 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:08.859144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 168/348] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:08 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:08.860169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9071429-9873-494d-bf89-f418a219c125 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:08.881095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d728f7-6f49-454e-8234-4765e2659405 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:08.919653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee06a9-601a-403b-bf6c-15117c1956fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:08.921027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee06a9-601a-403b-bf6c-15117c1956fd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.921513 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee06a9-601a-403b-bf6c-15117c1956fd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.922038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee06a9-601a-403b-bf6c-15117c1956fd None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.923543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee06a9-601a-403b-bf6c-15117c1956fd None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:08.925354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee06a9-601a-403b-bf6c-15117c1956fd None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:08.927513 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 181/349] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:08 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:08.929031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aadff-d329-421d-be6d-efde24257d29 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:08.929531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aadff-d329-421d-be6d-efde24257d29 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:08.930115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aadff-d329-421d-be6d-efde24257d29 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:08.931988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 182/350] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:08.932982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aadff-d329-421d-be6d-efde24257d29 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:08.949211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:08.969806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9071429-9873-494d-bf89-f418a219c125 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:08.976193 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:09.004706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854cc2f-3856-42a8-8451-935fb4729ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.005497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854cc2f-3856-42a8-8451-935fb4729ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.005778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854cc2f-3856-42a8-8451-935fb4729ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.006095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854cc2f-3856-42a8-8451-935fb4729ed7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.018034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854cc2f-3856-42a8-8451-935fb4729ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-1854cc2f-3856-42a8-8451-935fb4729ed7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:09.025959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:09.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:09.028009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 169/351] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:09.029141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854cc2f-3856-42a8-8451-935fb4729ed7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:09.061643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aadff-d329-421d-be6d-efde24257d29 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:09.104276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9f207-6819-43dc-9851-bf15d4ac026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.105215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f207-6819-43dc-9851-bf15d4ac026f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.105649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f207-6819-43dc-9851-bf15d4ac026f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.105994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9f207-6819-43dc-9851-bf15d4ac026f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.106908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f207-6819-43dc-9851-bf15d4ac026f None admin] RBAC: Adding query filter params (group.id=d31a486d208c4af0bab6aed950e9b559, role.id=048795d190224624ad8e995082b0faa0, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:09.107225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f207-6819-43dc-9851-bf15d4ac026f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:09.108788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9f207-6819-43dc-9851-bf15d4ac026f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:09.117144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 183/352] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:08 2022] GET /identity/v3/role_assignments?group.id=d31a486d208c4af0bab6aed950e9b559&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=048795d190224624ad8e995082b0faa0 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:09.118367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41454a35-eaf3-4bcd-b2a0-0a3b5651efc5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.118655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41454a35-eaf3-4bcd-b2a0-0a3b5651efc5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.119010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41454a35-eaf3-4bcd-b2a0-0a3b5651efc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.137788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854cc2f-3856-42a8-8451-935fb4729ed7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:09.138162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-41454a35-eaf3-4bcd-b2a0-0a3b5651efc5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:09.139546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-41454a35-eaf3-4bcd-b2a0-0a3b5651efc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:09.176314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc2dd-8173-47aa-a584-42eaa4a200fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.178256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc2dd-8173-47aa-a584-42eaa4a200fc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.178635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc2dd-8173-47aa-a584-42eaa4a200fc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.179005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc2dd-8173-47aa-a584-42eaa4a200fc None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.180414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cc2dd-8173-47aa-a584-42eaa4a200fc None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:09.182049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cc2dd-8173-47aa-a584-42eaa4a200fc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:09.184133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 170/353] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:09 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:09.185008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc2dd-8173-47aa-a584-42eaa4a200fc None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:09.206262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:09.255350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 184/354] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:09.257124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5851f-4993-499a-a371-3ef8031eafde None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.257608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5851f-4993-499a-a371-3ef8031eafde None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.258147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5851f-4993-499a-a371-3ef8031eafde None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.259746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 185/355] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:09.260704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5851f-4993-499a-a371-3ef8031eafde None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:09.296777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:09.313668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc2dd-8173-47aa-a584-42eaa4a200fc None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:09.352930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e879b9-447b-4791-8dad-6976bc0f7fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.353715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e879b9-447b-4791-8dad-6976bc0f7fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.354026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e879b9-447b-4791-8dad-6976bc0f7fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.354307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e879b9-447b-4791-8dad-6976bc0f7fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.355076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e879b9-447b-4791-8dad-6976bc0f7fd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:09.355385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e879b9-447b-4791-8dad-6976bc0f7fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:09.356793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e879b9-447b-4791-8dad-6976bc0f7fd2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:09.368523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 171/356] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:09.370042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b718-7b78-4bd4-97ba-8f9f4b35bbcd None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.370335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b718-7b78-4bd4-97ba-8f9f4b35bbcd None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.370614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b718-7b78-4bd4-97ba-8f9f4b35bbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.399577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7803b718-7b78-4bd4-97ba-8f9f4b35bbcd None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:09.402822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7803b718-7b78-4bd4-97ba-8f9f4b35bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:09.422517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5851f-4993-499a-a371-3ef8031eafde None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:09.476422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.477452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.478163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.478675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.479963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] RBAC: Adding query filter params (group.id=d31a486d208c4af0bab6aed950e9b559, role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:09.480646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:09.484302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:09.491472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 186/357] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:09 2022] GET /identity/v3/role_assignments?group.id=d31a486d208c4af0bab6aed950e9b559&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=1cafdd847d454019a89ce61428b4a863 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:09.495038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:09.525761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:09.534851 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 172/358] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:09.537031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803b718-7b78-4bd4-97ba-8f9f4b35bbcd None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:09.659022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:09.672557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d197f97-9a88-4699-ac85-6463943f5b1e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:09.707474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803b718-7b78-4bd4-97ba-8f9f4b35bbcd None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:09.747867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf4aa5-852b-42ba-b0a2-941ae91ce668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.748606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4aa5-852b-42ba-b0a2-941ae91ce668 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.748890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4aa5-852b-42ba-b0a2-941ae91ce668 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.749168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf4aa5-852b-42ba-b0a2-941ae91ce668 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.760349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c19947-5240-47a5-8bc6-ca5830b3522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.761114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c19947-5240-47a5-8bc6-ca5830b3522e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.761390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c19947-5240-47a5-8bc6-ca5830b3522e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.761661 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c19947-5240-47a5-8bc6-ca5830b3522e None admin] PATH_INFO: `/v3/users/9bb528cfa7194b16b1186ebf7cda955c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.765436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c19947-5240-47a5-8bc6-ca5830b3522e None admin] RBAC: Authorizing `identity:get_user(user_id=9bb528cfa7194b16b1186ebf7cda955c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:09.767580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c19947-5240-47a5-8bc6-ca5830b3522e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:09.768323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 173/359] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:25:09 2022] GET /identity/v3/users/9bb528cfa7194b16b1186ebf7cda955c => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:09.770223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c19947-5240-47a5-8bc6-ca5830b3522e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:09.772544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf4aa5-852b-42ba-b0a2-941ae91ce668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-3aaf4aa5-852b-42ba-b0a2-941ae91ce668 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:09.784811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:09.785795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:09.786676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:09.790500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 187/360] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:25:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:09.794257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aab9c-14e0-45a3-8286-72c2485bdd2f None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.795023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aab9c-14e0-45a3-8286-72c2485bdd2f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.795528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aab9c-14e0-45a3-8286-72c2485bdd2f None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.797191 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 188/361] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:09.798155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612aab9c-14e0-45a3-8286-72c2485bdd2f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:09.859712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:09.910491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c19947-5240-47a5-8bc6-ca5830b3522e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:09.930954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612aab9c-14e0-45a3-8286-72c2485bdd2f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:09.951729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cfa15-f1ae-486e-b78b-80053445581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.952557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cfa15-f1ae-486e-b78b-80053445581c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.952837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cfa15-f1ae-486e-b78b-80053445581c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.953108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3cfa15-f1ae-486e-b78b-80053445581c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.966382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3cfa15-f1ae-486e-b78b-80053445581c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:09.976443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5a4c8-8e65-494f-b1fe-21fc8f1887ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ca3cfa15-f1ae-486e-b78b-80053445581c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:09.976592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:09.977452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:09.978332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 174/362] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:09.980408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5a4c8-8e65-494f-b1fe-21fc8f1887ec None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:09.980514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cfa15-f1ae-486e-b78b-80053445581c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:09.981006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5a4c8-8e65-494f-b1fe-21fc8f1887ec None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:09.981472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5a4c8-8e65-494f-b1fe-21fc8f1887ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:09.982578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5a4c8-8e65-494f-b1fe-21fc8f1887ec None admin] RBAC: Adding query filter params (role.id=20aa0cf18e2b49ee859eef779cc3c45d, user.id=9bb528cfa7194b16b1186ebf7cda955c, scope.system=all) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:09.983201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5a4c8-8e65-494f-b1fe-21fc8f1887ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:09.985077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5a4c8-8e65-494f-b1fe-21fc8f1887ec None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:10.005349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 189/363] 10.222.0.61 () {56 vars in 1308 bytes} [Fri Jul 1 19:25:09 2022] GET /identity/v3/role_assignments?user.id=9bb528cfa7194b16b1186ebf7cda955c&scope.system=all&role.id=20aa0cf18e2b49ee859eef779cc3c45d => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:10.007754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fea09-d160-47be-a7ce-2600101d4075 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.008279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fea09-d160-47be-a7ce-2600101d4075 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.008766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fea09-d160-47be-a7ce-2600101d4075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.034779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-a92fea09-d160-47be-a7ce-2600101d4075 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:10.036347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a92fea09-d160-47be-a7ce-2600101d4075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:10.040336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.119216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3cfa15-f1ae-486e-b78b-80053445581c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.132851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 190/364] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:10.133729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fea09-d160-47be-a7ce-2600101d4075 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.165805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.174698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.175992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.176556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.177477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.179247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:10.179850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:10.181631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:10.191592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 175/365] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:10.194156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.260091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fea09-d160-47be-a7ce-2600101d4075 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.298284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.298997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.299613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.299727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.300491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:10.300803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:10.302304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:10.310196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1411-056f-4d58-8418-7399380e98fc None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.313479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 191/366] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:10.313848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.316638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.348158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf90ff4-b425-492f-8ca8-f3eab2c4f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.349320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf90ff4-b425-492f-8ca8-f3eab2c4f199 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.349835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf90ff4-b425-492f-8ca8-f3eab2c4f199 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.350347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf90ff4-b425-492f-8ca8-f3eab2c4f199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.361813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf90ff4-b425-492f-8ca8-f3eab2c4f199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-1bf90ff4-b425-492f-8ca8-f3eab2c4f199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:10.370079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:10.371013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:10.371835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:10.374530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 176/367] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:10.375526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf90ff4-b425-492f-8ca8-f3eab2c4f199 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.429430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ff2c6-229c-4f53-8061-3c59ac11d6ab None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.431495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.470877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3446de1-82e1-4870-942d-6056689ab90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.471533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3446de1-82e1-4870-942d-6056689ab90c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.471820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3446de1-82e1-4870-942d-6056689ab90c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.472101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3446de1-82e1-4870-942d-6056689ab90c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.486797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf90ff4-b425-492f-8ca8-f3eab2c4f199 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.526879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0f830-53fc-4f70-a2a0-f4c1037a4582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.528163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0f830-53fc-4f70-a2a0-f4c1037a4582 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.528653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0f830-53fc-4f70-a2a0-f4c1037a4582 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.529257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0f830-53fc-4f70-a2a0-f4c1037a4582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.568982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3446de1-82e1-4870-942d-6056689ab90c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:10.570854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3446de1-82e1-4870-942d-6056689ab90c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:10.574325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.622930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0f830-53fc-4f70-a2a0-f4c1037a4582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:10.624576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0f830-53fc-4f70-a2a0-f4c1037a4582 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:10.690331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.696719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 192/368] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:10.697929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3446de1-82e1-4870-942d-6056689ab90c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.757712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 177/369] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:10.759621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0f830-53fc-4f70-a2a0-f4c1037a4582 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.834447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3446de1-82e1-4870-942d-6056689ab90c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.837797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:10.879146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.879701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.880015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.880257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.881036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:10.881349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:10.882816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:10.888379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0f830-53fc-4f70-a2a0-f4c1037a4582 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:10.892527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 193/370] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:10.893420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.929570 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b7f5f-8601-4e70-88c7-0851787b85ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:10.930918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b7f5f-8601-4e70-88c7-0851787b85ed None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:10.931450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b7f5f-8601-4e70-88c7-0851787b85ed None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:10.931963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b7f5f-8601-4e70-88c7-0851787b85ed None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:10.933705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b7f5f-8601-4e70-88c7-0851787b85ed None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:10.935572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124b7f5f-8601-4e70-88c7-0851787b85ed None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:10.937776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 178/371] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:10.938791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b7f5f-8601-4e70-88c7-0851787b85ed None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:10.962927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.020614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d69385-b53d-47d3-91e5-c527773a00a6 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.071038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ad8a1-dce6-46b5-973a-c6fe2511f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.072761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad8a1-dce6-46b5-973a-c6fe2511f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.073232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad8a1-dce6-46b5-973a-c6fe2511f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.073699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ad8a1-dce6-46b5-973a-c6fe2511f6f8 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.076283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ad8a1-dce6-46b5-973a-c6fe2511f6f8 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.079151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ad8a1-dce6-46b5-973a-c6fe2511f6f8 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.080769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b7f5f-8601-4e70-88c7-0851787b85ed None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.083194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 194/372] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:11.083470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ad8a1-dce6-46b5-973a-c6fe2511f6f8 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.144086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.148083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b3e07-f7eb-43c9-8ccc-5ec0d10ef0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.149104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3e07-f7eb-43c9-8ccc-5ec0d10ef0eb None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.149579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3e07-f7eb-43c9-8ccc-5ec0d10ef0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.150095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b3e07-f7eb-43c9-8ccc-5ec0d10ef0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.267432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b3e07-f7eb-43c9-8ccc-5ec0d10ef0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.271060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b3e07-f7eb-43c9-8ccc-5ec0d10ef0eb None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.276725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ad8a1-dce6-46b5-973a-c6fe2511f6f8 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.301077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.343320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bdca7-6782-4f86-977c-3bb47a53aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.344723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bdca7-6782-4f86-977c-3bb47a53aa00 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.345171 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bdca7-6782-4f86-977c-3bb47a53aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.345636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bdca7-6782-4f86-977c-3bb47a53aa00 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.347522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bdca7-6782-4f86-977c-3bb47a53aa00 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.350352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bdca7-6782-4f86-977c-3bb47a53aa00 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.353819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 195/373] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:11.355508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bdca7-6782-4f86-977c-3bb47a53aa00 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.435582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 179/374] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:11.437316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b3e07-f7eb-43c9-8ccc-5ec0d10ef0eb None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.508435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.511798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bdca7-6782-4f86-977c-3bb47a53aa00 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.549233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a2041-88d3-4f00-9d9f-948a52f392a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.550276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a2041-88d3-4f00-9d9f-948a52f392a7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.550558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a2041-88d3-4f00-9d9f-948a52f392a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.550838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a2041-88d3-4f00-9d9f-948a52f392a7 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.552196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a2041-88d3-4f00-9d9f-948a52f392a7 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.553647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a2041-88d3-4f00-9d9f-948a52f392a7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.554629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b3e07-f7eb-43c9-8ccc-5ec0d10ef0eb None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.558017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 196/375] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:11.558306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a2041-88d3-4f00-9d9f-948a52f392a7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.579379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.599034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.599973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.600390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.600798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.601770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] RBAC: Adding query filter params (group.id=d31a486d208c4af0bab6aed950e9b559, role.id=048795d190224624ad8e995082b0faa0, scope.project.id=d7e62e4fa17345388ed4552283040e34) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:11.602255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.603873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.610164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 180/376] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/role_assignments?group.id=d31a486d208c4af0bab6aed950e9b559&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=048795d190224624ad8e995082b0faa0 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:11.611259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.695287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a2041-88d3-4f00-9d9f-948a52f392a7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.740352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f50f7d-30b4-4dc3-a899-35ecb8cff93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.741285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f50f7d-30b4-4dc3-a899-35ecb8cff93a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.741573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f50f7d-30b4-4dc3-a899-35ecb8cff93a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.741852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f50f7d-30b4-4dc3-a899-35ecb8cff93a None admin] PATH_INFO: `/v3/projects/2c274d3083ff496a9f0346d090423253` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.743376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f50f7d-30b4-4dc3-a899-35ecb8cff93a None admin] RBAC: Authorizing `identity:get_project(project_id=2c274d3083ff496a9f0346d090423253)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.745229 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f50f7d-30b4-4dc3-a899-35ecb8cff93a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.748288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 197/377] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/projects/2c274d3083ff496a9f0346d090423253 => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:11.753972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f50f7d-30b4-4dc3-a899-35ecb8cff93a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:11.761916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d791a-d810-4d4b-9f36-b2a4e0f22a8b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:11.826550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c8868-8b11-4262-94ea-56a8ec65c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:11.827248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8868-8b11-4262-94ea-56a8ec65c379 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.827535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8868-8b11-4262-94ea-56a8ec65c379 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.827813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c8868-8b11-4262-94ea-56a8ec65c379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.828255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:11.828977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8868-8b11-4262-94ea-56a8ec65c379 None admin] RBAC: Adding query filter params (group.id=d31a486d208c4af0bab6aed950e9b559, role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=d7e62e4fa17345388ed4552283040e34) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:11.828977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8868-8b11-4262-94ea-56a8ec65c379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:11.831912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c8868-8b11-4262-94ea-56a8ec65c379 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:11.839060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 181/378] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/role_assignments?group.id=d31a486d208c4af0bab6aed950e9b559&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=1cafdd847d454019a89ce61428b4a863 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:11.916569 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f08c7-f734-40c0-80fc-8588be50e009 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.916859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f08c7-f734-40c0-80fc-8588be50e009 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.917131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f08c7-f734-40c0-80fc-8588be50e009 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.919336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 182/379] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:11.925432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ea9c-475f-4394-aafb-a229c1a20ef1 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:11.925742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ea9c-475f-4394-aafb-a229c1a20ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:11.926006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ea9c-475f-4394-aafb-a229c1a20ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:11.948911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1e72ea9c-475f-4394-aafb-a229c1a20ef1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:11.950063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1e72ea9c-475f-4394-aafb-a229c1a20ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:11.966315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f50f7d-30b4-4dc3-a899-35ecb8cff93a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.031456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.038677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87585f4-f7c2-4ab5-9d17-8f1a920eb154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.039539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87585f4-f7c2-4ab5-9d17-8f1a920eb154 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.039822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87585f4-f7c2-4ab5-9d17-8f1a920eb154 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.040100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87585f4-f7c2-4ab5-9d17-8f1a920eb154 None admin] PATH_INFO: `/v3/groups/68fc0712294a49aeb1a9d4024dd91780` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.049326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87585f4-f7c2-4ab5-9d17-8f1a920eb154 None admin] RBAC: Authorizing `identity:get_group(group_id=68fc0712294a49aeb1a9d4024dd91780)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.050879 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87585f4-f7c2-4ab5-9d17-8f1a920eb154 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.052901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 198/380] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:11 2022] GET /identity/v3/groups/68fc0712294a49aeb1a9d4024dd91780 => generated 229 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:12.054204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd1ba-7a86-48cb-b823-443caa3157db None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.054492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd1ba-7a86-48cb-b823-443caa3157db None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.054777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fd1ba-7a86-48cb-b823-443caa3157db None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.058336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 199/381] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:12.064332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3997c-270d-4bbc-9e2c-b3101f54287e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.064619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3997c-270d-4bbc-9e2c-b3101f54287e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.064894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3997c-270d-4bbc-9e2c-b3101f54287e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.072848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 183/382] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:12.073936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ea9c-475f-4394-aafb-a229c1a20ef1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.092195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-5da3997c-270d-4bbc-9e2c-b3101f54287e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:12.093800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5da3997c-270d-4bbc-9e2c-b3101f54287e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:12.173423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 200/383] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:12.175182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3997c-270d-4bbc-9e2c-b3101f54287e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.207542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.209547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ea9c-475f-4394-aafb-a229c1a20ef1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.250342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.251007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.251288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.251557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.252526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] RBAC: Adding query filter params (group.id=68fc0712294a49aeb1a9d4024dd91780, role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=2c274d3083ff496a9f0346d090423253) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:12.252808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.254399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.261920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 184/384] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/role_assignments?group.id=68fc0712294a49aeb1a9d4024dd91780&scope.project.id=2c274d3083ff496a9f0346d090423253&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:12.262979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.288663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3997c-270d-4bbc-9e2c-b3101f54287e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.316536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.328147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227232e8-2539-4782-bfc5-14d70d8f290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.329403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227232e8-2539-4782-bfc5-14d70d8f290c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.329875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227232e8-2539-4782-bfc5-14d70d8f290c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.330381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227232e8-2539-4782-bfc5-14d70d8f290c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.343027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227232e8-2539-4782-bfc5-14d70d8f290c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-227232e8-2539-4782-bfc5-14d70d8f290c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:12.352011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:12.352928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:12.353782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:12.356575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 201/385] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:12.362995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227232e8-2539-4782-bfc5-14d70d8f290c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.433259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ab240-ce44-4bdf-893b-292415205730 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.463021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.473853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227232e8-2539-4782-bfc5-14d70d8f290c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.496263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a69785-5df9-4f10-84ba-fe05c0dc685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.497075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a69785-5df9-4f10-84ba-fe05c0dc685f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.497375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a69785-5df9-4f10-84ba-fe05c0dc685f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.497638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a69785-5df9-4f10-84ba-fe05c0dc685f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.517222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.518301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.518778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.520589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.521673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:12.522492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.523251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a69785-5df9-4f10-84ba-fe05c0dc685f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:12.524891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.542748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 202/386] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-f4a69785-5df9-4f10-84ba-fe05c0dc685f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:12.544144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:12.544993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:12.545759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:12.548340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 185/387] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:12.549439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.554002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a69785-5df9-4f10-84ba-fe05c0dc685f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.723097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.727492 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a69785-5df9-4f10-84ba-fe05c0dc685f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.739655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50a392-2058-4db2-a8c6-bd044ec16bbc None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.790280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.791035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.791320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.791595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.792353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:12.792660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.794067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.800012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d47e-c464-40d6-9b84-b88634509fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:12.800867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d47e-c464-40d6-9b84-b88634509fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:12.801154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d47e-c464-40d6-9b84-b88634509fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:12.801434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336d47e-c464-40d6-9b84-b88634509fb1 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:12.803304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d47e-c464-40d6-9b84-b88634509fb1 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:12.804736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5336d47e-c464-40d6-9b84-b88634509fb1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:12.806442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 203/388] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:12.812061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d47e-c464-40d6-9b84-b88634509fb1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.814327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 186/389] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:12.828152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:12.856694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:12.964215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336d47e-c464-40d6-9b84-b88634509fb1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:12.974018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4fec7-ed7d-40e0-b47e-883c154eda73 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:13.013040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ae4b-90e6-44a9-b05b-2d95a2df4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:13.014869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ae4b-90e6-44a9-b05b-2d95a2df4e26 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:13.015389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ae4b-90e6-44a9-b05b-2d95a2df4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:13.015860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ae4b-90e6-44a9-b05b-2d95a2df4e26 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:13.017440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ae4b-90e6-44a9-b05b-2d95a2df4e26 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:13.019572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ae4b-90e6-44a9-b05b-2d95a2df4e26 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:13.022446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 187/390] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:13.048894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ae4b-90e6-44a9-b05b-2d95a2df4e26 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:13.071795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048a9b9-0d7c-48d5-8007-91561c6e5d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:13.074376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a9b9-0d7c-48d5-8007-91561c6e5d48 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:13.074376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a9b9-0d7c-48d5-8007-91561c6e5d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:13.074376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048a9b9-0d7c-48d5-8007-91561c6e5d48 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:13.074738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048a9b9-0d7c-48d5-8007-91561c6e5d48 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:13.076168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048a9b9-0d7c-48d5-8007-91561c6e5d48 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:13.078081 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 204/391] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:12 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:13.088650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048a9b9-0d7c-48d5-8007-91561c6e5d48 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:13.116717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:13.235129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048a9b9-0d7c-48d5-8007-91561c6e5d48 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:13.239849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ae4b-90e6-44a9-b05b-2d95a2df4e26 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:13.247696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:13.287684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dc38c-870d-47f1-9b97-88e12ca03c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:13.288628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dc38c-870d-47f1-9b97-88e12ca03c57 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:13.288909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dc38c-870d-47f1-9b97-88e12ca03c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:13.289297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dc38c-870d-47f1-9b97-88e12ca03c57 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/groups/d31a486d208c4af0bab6aed950e9b559/roles/048795d190224624ad8e995082b0faa0` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:13.291724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dc38c-870d-47f1-9b97-88e12ca03c57 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d89269d1e3a4ff8be3465cf7d5bec29, group_id=d31a486d208c4af0bab6aed950e9b559, role_id=048795d190224624ad8e995082b0faa0)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:13.293180 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dc38c-870d-47f1-9b97-88e12ca03c57 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:13.301599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a09669-3671-465f-a703-3dd787cdffe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:13.302670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a09669-3671-465f-a703-3dd787cdffe9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:13.302954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a09669-3671-465f-a703-3dd787cdffe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:13.303232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a09669-3671-465f-a703-3dd787cdffe9 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:13.307109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a09669-3671-465f-a703-3dd787cdffe9 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:13.308718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a09669-3671-465f-a703-3dd787cdffe9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:13.310762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 188/392] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:13 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:13.311558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 205/393] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jul 1 19:25:13 2022] PUT /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/groups/d31a486d208c4af0bab6aed950e9b559/roles/048795d190224624ad8e995082b0faa0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:13.322227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a09669-3671-465f-a703-3dd787cdffe9 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:13.480832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:13.485308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a09669-3671-465f-a703-3dd787cdffe9 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:13.523308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb526af-8b80-4bca-8d23-d4f33e353a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:13.524205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb526af-8b80-4bca-8d23-d4f33e353a75 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:13.524488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb526af-8b80-4bca-8d23-d4f33e353a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:13.524763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb526af-8b80-4bca-8d23-d4f33e353a75 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/groups/d31a486d208c4af0bab6aed950e9b559/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:13.526855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb526af-8b80-4bca-8d23-d4f33e353a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d89269d1e3a4ff8be3465cf7d5bec29, group_id=d31a486d208c4af0bab6aed950e9b559, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:13.528312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb526af-8b80-4bca-8d23-d4f33e353a75 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:13.546276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 189/394] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jul 1 19:25:13 2022] PUT /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29/groups/d31a486d208c4af0bab6aed950e9b559/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:14.193017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d1443-5913-453c-85d7-01829bc98b36 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:14.193723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d1443-5913-453c-85d7-01829bc98b36 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:14.194235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d1443-5913-453c-85d7-01829bc98b36 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:14.195853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 206/395] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:14.201616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba889b-371d-44d5-9b09-ae1446d4162f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:14.202204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba889b-371d-44d5-9b09-ae1446d4162f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:14.202673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba889b-371d-44d5-9b09-ae1446d4162f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:14.221757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-adba889b-371d-44d5-9b09-ae1446d4162f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:14.223316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-adba889b-371d-44d5-9b09-ae1446d4162f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:14.307619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 190/396] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:14.331716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d1443-5913-453c-85d7-01829bc98b36 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:14.362884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52a7e-9693-4345-85f5-81453400603f None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:14.363395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52a7e-9693-4345-85f5-81453400603f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:14.363468 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee52a7e-9693-4345-85f5-81453400603f None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:14.365081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 191/397] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:14.370906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce5c5-4b20-40c7-9956-be2e13ae6270 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:14.371192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce5c5-4b20-40c7-9956-be2e13ae6270 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:14.371476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce5c5-4b20-40c7-9956-be2e13ae6270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:14.402988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-df1ce5c5-4b20-40c7-9956-be2e13ae6270 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:14.404200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-df1ce5c5-4b20-40c7-9956-be2e13ae6270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:14.452682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d1443-5913-453c-85d7-01829bc98b36 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:14.517907 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 192/398] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:14.520303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405b1eb-f8ca-4949-9020-77a98cdf7aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:14.521357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b1eb-f8ca-4949-9020-77a98cdf7aaf None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:14.521855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b1eb-f8ca-4949-9020-77a98cdf7aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:14.522358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405b1eb-f8ca-4949-9020-77a98cdf7aaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:14.533800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405b1eb-f8ca-4949-9020-77a98cdf7aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-1405b1eb-f8ca-4949-9020-77a98cdf7aaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:14.542336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:14.543204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:14.543971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:14.550074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 207/399] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:25:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:14.552967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ce5c5-4b20-40c7-9956-be2e13ae6270 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:14.565769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405b1eb-f8ca-4949-9020-77a98cdf7aaf None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:14.585581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:14.614474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:14.729344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ce5c5-4b20-40c7-9956-be2e13ae6270 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:14.772331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:14.773029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:14.773309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:14.773581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:14.774573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:14.774882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:14.776764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:14.796002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 193/400] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:14.802069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:14.804124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405b1eb-f8ca-4949-9020-77a98cdf7aaf None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:14.902326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:14.908464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bb12f-82a5-4c34-bb26-a1aba947302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:14.909310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bb12f-82a5-4c34-bb26-a1aba947302a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:14.909553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bb12f-82a5-4c34-bb26-a1aba947302a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:14.909969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bb12f-82a5-4c34-bb26-a1aba947302a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:14.928108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a9048b-0a77-4bae-a3cc-a058a8951653 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:14.937533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bb12f-82a5-4c34-bb26-a1aba947302a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-ee1bb12f-82a5-4c34-bb26-a1aba947302a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:14.951063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:14.951988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:14.952770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:14.954818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 208/401] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:14.960438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bb12f-82a5-4c34-bb26-a1aba947302a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:14.993362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685101b-225d-4909-9f85-41691a559cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:14.994398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685101b-225d-4909-9f85-41691a559cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:14.994682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685101b-225d-4909-9f85-41691a559cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:14.995004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685101b-225d-4909-9f85-41691a559cb5 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:14.996193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685101b-225d-4909-9f85-41691a559cb5 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:15.001969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685101b-225d-4909-9f85-41691a559cb5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:15.003507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 194/402] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:14 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:15.006246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685101b-225d-4909-9f85-41691a559cb5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.130012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685101b-225d-4909-9f85-41691a559cb5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.154060 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.175763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4f7c-74df-4841-876c-d23a0f25cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.176637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4f7c-74df-4841-876c-d23a0f25cf00 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.176915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4f7c-74df-4841-876c-d23a0f25cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.177185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4f7c-74df-4841-876c-d23a0f25cf00 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.179808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a4f7c-74df-4841-876c-d23a0f25cf00 None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:15.181416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a4f7c-74df-4841-876c-d23a0f25cf00 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:15.183210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 195/403] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:15 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:15.190045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4f7c-74df-4841-876c-d23a0f25cf00 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.229711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bb12f-82a5-4c34-bb26-a1aba947302a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.232783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.304592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0f00d-2946-416f-8a14-7dded2face88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.305717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0f00d-2946-416f-8a14-7dded2face88 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.306470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0f00d-2946-416f-8a14-7dded2face88 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.306959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0f00d-2946-416f-8a14-7dded2face88 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.307970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0f00d-2946-416f-8a14-7dded2face88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:15.308559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0f00d-2946-416f-8a14-7dded2face88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:15.310260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0f00d-2946-416f-8a14-7dded2face88 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:15.320350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 209/404] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:15.322287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76600e-0879-4335-8c30-18e69077b578 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.322871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76600e-0879-4335-8c30-18e69077b578 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.323355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a76600e-0879-4335-8c30-18e69077b578 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.328993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 210/405] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:15.330156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76600e-0879-4335-8c30-18e69077b578 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.357317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4f7c-74df-4841-876c-d23a0f25cf00 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.405355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca605e1b-4319-4047-a58f-724ab14837df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.406198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca605e1b-4319-4047-a58f-724ab14837df None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.406476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca605e1b-4319-4047-a58f-724ab14837df None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.406746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca605e1b-4319-4047-a58f-724ab14837df None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34/groups/d31a486d208c4af0bab6aed950e9b559/roles/048795d190224624ad8e995082b0faa0` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.411443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca605e1b-4319-4047-a58f-724ab14837df None admin] RBAC: Authorizing `identity:create_grant(project_id=d7e62e4fa17345388ed4552283040e34, group_id=d31a486d208c4af0bab6aed950e9b559, role_id=048795d190224624ad8e995082b0faa0)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:15.413314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca605e1b-4319-4047-a58f-724ab14837df None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:15.436922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 196/406] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jul 1 19:25:15 2022] PUT /identity/v3/projects/d7e62e4fa17345388ed4552283040e34/groups/d31a486d208c4af0bab6aed950e9b559/roles/048795d190224624ad8e995082b0faa0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:15.439092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036403-6dd0-4b1b-900c-a2c29832b6d2 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.439587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036403-6dd0-4b1b-900c-a2c29832b6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.440058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc036403-6dd0-4b1b-900c-a2c29832b6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.456883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a76600e-0879-4335-8c30-18e69077b578 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.465215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bc036403-6dd0-4b1b-900c-a2c29832b6d2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:15.467456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bc036403-6dd0-4b1b-900c-a2c29832b6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:15.493868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.501478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34e094-08db-49b4-8c42-a360364f5a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.503037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34e094-08db-49b4-8c42-a360364f5a88 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.503765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34e094-08db-49b4-8c42-a360364f5a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.504416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34e094-08db-49b4-8c42-a360364f5a88 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.505765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34e094-08db-49b4-8c42-a360364f5a88 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:15.507459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34e094-08db-49b4-8c42-a360364f5a88 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:15.509303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 211/407] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:15 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:15.515715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34e094-08db-49b4-8c42-a360364f5a88 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.562981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 197/408] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:15.610160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc036403-6dd0-4b1b-900c-a2c29832b6d2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.621176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.658758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34e094-08db-49b4-8c42-a360364f5a88 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.699343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1648a0-0344-45aa-8f9b-3c4d2b2e117d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.700414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1648a0-0344-45aa-8f9b-3c4d2b2e117d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.700793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1648a0-0344-45aa-8f9b-3c4d2b2e117d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.701167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1648a0-0344-45aa-8f9b-3c4d2b2e117d None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.702613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1648a0-0344-45aa-8f9b-3c4d2b2e117d None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:15.704271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1648a0-0344-45aa-8f9b-3c4d2b2e117d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:15.706382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 212/409] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:15 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:15.712775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1648a0-0344-45aa-8f9b-3c4d2b2e117d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.739193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc036403-6dd0-4b1b-900c-a2c29832b6d2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.780508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddcb01-5219-4845-96fb-2dd744e09004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.781768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddcb01-5219-4845-96fb-2dd744e09004 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.782257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddcb01-5219-4845-96fb-2dd744e09004 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.782729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddcb01-5219-4845-96fb-2dd744e09004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.787766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.797123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddcb01-5219-4845-96fb-2dd744e09004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-d7ddcb01-5219-4845-96fb-2dd744e09004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:15.805662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:15.806760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:15.807540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:15.810258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 198/410] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:15.816387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddcb01-5219-4845-96fb-2dd744e09004 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:15.836618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1648a0-0344-45aa-8f9b-3c4d2b2e117d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:15.902592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ab203-1f20-454e-8c33-ad053f1be677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:15.906466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab203-1f20-454e-8c33-ad053f1be677 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.906953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab203-1f20-454e-8c33-ad053f1be677 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.907423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab203-1f20-454e-8c33-ad053f1be677 None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34/groups/d31a486d208c4af0bab6aed950e9b559/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.910778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ab203-1f20-454e-8c33-ad053f1be677 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7e62e4fa17345388ed4552283040e34, group_id=d31a486d208c4af0bab6aed950e9b559, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:15.912608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ab203-1f20-454e-8c33-ad053f1be677 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:15.929417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:15.941860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 213/411] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jul 1 19:25:15 2022] PUT /identity/v3/projects/d7e62e4fa17345388ed4552283040e34/groups/d31a486d208c4af0bab6aed950e9b559/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:25:15.982081 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cee3-aa92-4875-b504-ba6454e7ce0a None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.982753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cee3-aa92-4875-b504-ba6454e7ce0a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.983312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cee3-aa92-4875-b504-ba6454e7ce0a None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:15.985452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 214/412] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:15.990692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8310-144f-4a5f-bbd8-49b69b8a6e6f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:15.991313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8310-144f-4a5f-bbd8-49b69b8a6e6f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:15.991782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a8310-144f-4a5f-bbd8-49b69b8a6e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.010569 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddcb01-5219-4845-96fb-2dd744e09004 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.023211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-488a8310-144f-4a5f-bbd8-49b69b8a6e6f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:16.026248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-488a8310-144f-4a5f-bbd8-49b69b8a6e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:16.091685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.095742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.096335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.096833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.097836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:16.098660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.101241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.122603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 199/413] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:16.128421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.181551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 215/414] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:16.204723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722acc-d25b-42a1-99e8-459c101fcfe2 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.204723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722acc-d25b-42a1-99e8-459c101fcfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.204995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef722acc-d25b-42a1-99e8-459c101fcfe2 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.206761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 216/415] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:16.207498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722acc-d25b-42a1-99e8-459c101fcfe2 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.249593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57a399-9d48-43a1-a4d8-69d39adca9e5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.271688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.280827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.290609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d9457-6822-4757-9830-fc02ed5423bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.291660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d9457-6822-4757-9830-fc02ed5423bc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.292036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d9457-6822-4757-9830-fc02ed5423bc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.292404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d9457-6822-4757-9830-fc02ed5423bc None admin] PATH_INFO: `/v3/groups/68fc0712294a49aeb1a9d4024dd91780` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.293691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d9457-6822-4757-9830-fc02ed5423bc None admin] RBAC: Authorizing `identity:get_group(group_id=68fc0712294a49aeb1a9d4024dd91780)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.295398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d9457-6822-4757-9830-fc02ed5423bc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.297481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 200/416] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/groups/68fc0712294a49aeb1a9d4024dd91780 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:16.298942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6bf8-8d75-4059-a499-df4dfd457239 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.299302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6bf8-8d75-4059-a499-df4dfd457239 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.299672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6bf8-8d75-4059-a499-df4dfd457239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.316688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-78cf6bf8-8d75-4059-a499-df4dfd457239 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:16.318174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-78cf6bf8-8d75-4059-a499-df4dfd457239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:16.323337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef722acc-d25b-42a1-99e8-459c101fcfe2 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.361280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01075a05-d0bc-4fdc-8fd0-4b0914f340f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.362138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075a05-d0bc-4fdc-8fd0-4b0914f340f1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.362465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075a05-d0bc-4fdc-8fd0-4b0914f340f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.362787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075a05-d0bc-4fdc-8fd0-4b0914f340f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.374737 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01075a05-d0bc-4fdc-8fd0-4b0914f340f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-01075a05-d0bc-4fdc-8fd0-4b0914f340f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:16.383774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:16.384769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:16.385680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:16.390227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 217/417] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:16.391189 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01075a05-d0bc-4fdc-8fd0-4b0914f340f1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.392486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 201/418] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:16.393399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf6bf8-8d75-4059-a499-df4dfd457239 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.502901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf6bf8-8d75-4059-a499-df4dfd457239 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.511607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01075a05-d0bc-4fdc-8fd0-4b0914f340f1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.529777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.532048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.542485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.543765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.544244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.544902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.545974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:16.546430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.548341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.552342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc38f9a-790e-4615-a546-e38c1e95ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.553367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38f9a-790e-4615-a546-e38c1e95ad55 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.553816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38f9a-790e-4615-a546-e38c1e95ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.554331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc38f9a-790e-4615-a546-e38c1e95ad55 None admin] PATH_INFO: `/v3/projects/2c274d3083ff496a9f0346d090423253` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.555646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc38f9a-790e-4615-a546-e38c1e95ad55 None admin] RBAC: Authorizing `identity:get_project(project_id=2c274d3083ff496a9f0346d090423253)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.557228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc38f9a-790e-4615-a546-e38c1e95ad55 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.557997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 202/419] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:16.558885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.559691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 218/420] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/projects/2c274d3083ff496a9f0346d090423253 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:16.563035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc38f9a-790e-4615-a546-e38c1e95ad55 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.664007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbce073-6d19-4574-b809-91ebff2d0bd8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.669000 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc38f9a-790e-4615-a546-e38c1e95ad55 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.700311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedebd42-a695-4112-a7ca-8b024b1ac774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.701266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebd42-a695-4112-a7ca-8b024b1ac774 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.701643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebd42-a695-4112-a7ca-8b024b1ac774 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.702038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedebd42-a695-4112-a7ca-8b024b1ac774 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.705617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94919c94-de1c-4c1a-9be4-e99f2bc1f4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.706516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94919c94-de1c-4c1a-9be4-e99f2bc1f4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.706937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94919c94-de1c-4c1a-9be4-e99f2bc1f4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.707347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94919c94-de1c-4c1a-9be4-e99f2bc1f4f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.714141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedebd42-a695-4112-a7ca-8b024b1ac774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-aedebd42-a695-4112-a7ca-8b024b1ac774 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:16.722576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:16.723678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:16.724597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:16.730352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 203/421] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:16.731300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedebd42-a695-4112-a7ca-8b024b1ac774 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.767771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.784725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94919c94-de1c-4c1a-9be4-e99f2bc1f4f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.786568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:16.787271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94919c94-de1c-4c1a-9be4-e99f2bc1f4f2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.844603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedebd42-a695-4112-a7ca-8b024b1ac774 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:16.893366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b089e88-70a1-4049-a0c6-4c694e4891e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:16.894398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b089e88-70a1-4049-a0c6-4c694e4891e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:16.894703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b089e88-70a1-4049-a0c6-4c694e4891e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:16.895161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b089e88-70a1-4049-a0c6-4c694e4891e0 None admin] PATH_INFO: `/v3/projects/2c274d3083ff496a9f0346d090423253/groups/68fc0712294a49aeb1a9d4024dd91780/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:16.897055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b089e88-70a1-4049-a0c6-4c694e4891e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c274d3083ff496a9f0346d090423253, group_id=68fc0712294a49aeb1a9d4024dd91780, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:16.898826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b089e88-70a1-4049-a0c6-4c694e4891e0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:16.905378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 219/422] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:16.906527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94919c94-de1c-4c1a-9be4-e99f2bc1f4f2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:16.920901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 204/423] 10.222.0.61 () {58 vars in 1442 bytes} [Fri Jul 1 19:25:16 2022] PUT /identity/v3/projects/2c274d3083ff496a9f0346d090423253/groups/68fc0712294a49aeb1a9d4024dd91780/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:16.921984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b089e88-70a1-4049-a0c6-4c694e4891e0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.002517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.016372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94919c94-de1c-4c1a-9be4-e99f2bc1f4f2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.057101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.057697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.058001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.058279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.059139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:17.059445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.061106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.071501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 220/424] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:17.077832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.157890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b089e88-70a1-4049-a0c6-4c694e4891e0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.168064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.202801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20847e-6063-46bf-b8b5-4ecff47e4ab1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.206345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a94c8-4586-4b57-a109-cf81bef2fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.207460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a94c8-4586-4b57-a109-cf81bef2fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.207884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a94c8-4586-4b57-a109-cf81bef2fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.208406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a94c8-4586-4b57-a109-cf81bef2fbdd None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.209775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a94c8-4586-4b57-a109-cf81bef2fbdd None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.212505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a94c8-4586-4b57-a109-cf81bef2fbdd None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.214946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 205/425] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:16 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:17.221004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a94c8-4586-4b57-a109-cf81bef2fbdd None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.240932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71ca6-1941-44d8-9d7c-60cc8c190c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.241822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71ca6-1941-44d8-9d7c-60cc8c190c1c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.242147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71ca6-1941-44d8-9d7c-60cc8c190c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.242440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead71ca6-1941-44d8-9d7c-60cc8c190c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.266682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.331625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71ca6-1941-44d8-9d7c-60cc8c190c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.333740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead71ca6-1941-44d8-9d7c-60cc8c190c1c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.335263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a94c8-4586-4b57-a109-cf81bef2fbdd None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.401785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad7bdf-7db4-4e98-91e1-e7c5117fc869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.404824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7bdf-7db4-4e98-91e1-e7c5117fc869 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.404824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7bdf-7db4-4e98-91e1-e7c5117fc869 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.404824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7bdf-7db4-4e98-91e1-e7c5117fc869 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.405592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad7bdf-7db4-4e98-91e1-e7c5117fc869 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.407079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad7bdf-7db4-4e98-91e1-e7c5117fc869 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.408726 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 206/426] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:17.414736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad7bdf-7db4-4e98-91e1-e7c5117fc869 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.482936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.550846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad7bdf-7db4-4e98-91e1-e7c5117fc869 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.556984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 221/427] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:25:17.567008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71ca6-1941-44d8-9d7c-60cc8c190c1c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.592503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.593579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.595462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.595990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.597036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] RBAC: Adding query filter params (group.id=d31a486d208c4af0bab6aed950e9b559, role.id=048795d190224624ad8e995082b0faa0, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:17.597771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.599864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.607992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 207/428] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/role_assignments?group.id=d31a486d208c4af0bab6aed950e9b559&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=048795d190224624ad8e995082b0faa0 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:17.653922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.746501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead71ca6-1941-44d8-9d7c-60cc8c190c1c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.799039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda0da4-3051-4145-99c2-fe0999375149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.799923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda0da4-3051-4145-99c2-fe0999375149 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.800202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda0da4-3051-4145-99c2-fe0999375149 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.800474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda0da4-3051-4145-99c2-fe0999375149 None admin] PATH_INFO: `/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.801682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda0da4-3051-4145-99c2-fe0999375149 None admin] RBAC: Authorizing `identity:get_project(project_id=6d89269d1e3a4ff8be3465cf7d5bec29)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.803177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda0da4-3051-4145-99c2-fe0999375149 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.805227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 222/429] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/projects/6d89269d1e3a4ff8be3465cf7d5bec29 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:17.810614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:17.929813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe0da-9742-4d74-9932-1887dd050387 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:17.942278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:17.968768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cfd772-ed0b-4652-bdf6-837495807500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:17.969641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfd772-ed0b-4652-bdf6-837495807500 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:17.969920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfd772-ed0b-4652-bdf6-837495807500 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:17.970219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cfd772-ed0b-4652-bdf6-837495807500 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:17.971418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfd772-ed0b-4652-bdf6-837495807500 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:17.972923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cfd772-ed0b-4652-bdf6-837495807500 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:17.974963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 208/430] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:17.982286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda0da4-3051-4145-99c2-fe0999375149 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:18.084973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ac72-40ab-4c4f-be6e-be0569edd496 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.085272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ac72-40ab-4c4f-be6e-be0569edd496 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.085527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ac72-40ab-4c4f-be6e-be0569edd496 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.087507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 209/431] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:18.088763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda0da4-3051-4145-99c2-fe0999375149 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:18.095135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa109c-505f-4514-bc33-458fe2c976bc None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.095661 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa109c-505f-4514-bc33-458fe2c976bc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.096152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa109c-505f-4514-bc33-458fe2c976bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.107045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:18.115457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f6aa109c-505f-4514-bc33-458fe2c976bc None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:18.117869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f6aa109c-505f-4514-bc33-458fe2c976bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:18.133759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:18.134892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.135336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.135752 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.136724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] RBAC: Adding query filter params (group.id=d31a486d208c4af0bab6aed950e9b559, role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:18.137179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:18.138822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:18.145339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 223/432] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:17 2022] GET /identity/v3/role_assignments?group.id=d31a486d208c4af0bab6aed950e9b559&scope.project.id=6d89269d1e3a4ff8be3465cf7d5bec29&role.id=1cafdd847d454019a89ce61428b4a863 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:18.204957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 210/433] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:18.230337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:18.235296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227ae1-3327-4b1e-b9ca-859e137d8f4d None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.235579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227ae1-3327-4b1e-b9ca-859e137d8f4d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.235858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41227ae1-3327-4b1e-b9ca-859e137d8f4d None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.237532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 211/434] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:18.243202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1eb5b-801f-4692-8761-cac47bb73279 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.243479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1eb5b-801f-4692-8761-cac47bb73279 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.243803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1eb5b-801f-4692-8761-cac47bb73279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.261931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1fb1eb5b-801f-4692-8761-cac47bb73279 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:18.263265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1fb1eb5b-801f-4692-8761-cac47bb73279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:18.348914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 212/435] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:18.354742 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ccf07-ad74-4fd6-ad35-cefd5daa9913 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:18.374317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1eb5b-801f-4692-8761-cac47bb73279 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:18.395466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337755b4-fb2b-406b-98c0-873adcdf193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:18.396192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337755b4-fb2b-406b-98c0-873adcdf193d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.396470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337755b4-fb2b-406b-98c0-873adcdf193d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.396816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337755b4-fb2b-406b-98c0-873adcdf193d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.414116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337755b4-fb2b-406b-98c0-873adcdf193d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:18.422077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-337755b4-fb2b-406b-98c0-873adcdf193d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:18.423001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:18.423856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:18.424661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 224/436] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:25:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:18.430024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337755b4-fb2b-406b-98c0-873adcdf193d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:18.487691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:18.502057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1eb5b-801f-4692-8761-cac47bb73279 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:18.548635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db4d6d-204f-46a0-a77a-072a3ff8d3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:18.549437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4d6d-204f-46a0-a77a-072a3ff8d3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.549711 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4d6d-204f-46a0-a77a-072a3ff8d3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.550007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db4d6d-204f-46a0-a77a-072a3ff8d3b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.563986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db4d6d-204f-46a0-a77a-072a3ff8d3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:18.568049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337755b4-fb2b-406b-98c0-873adcdf193d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-11db4d6d-204f-46a0-a77a-072a3ff8d3b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:18.571994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:18.572913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:18.573720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 213/437] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:18.580778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db4d6d-204f-46a0-a77a-072a3ff8d3b7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:18.614432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:18.615493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.616030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.616370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.617314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:18.617636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:18.619704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:18.634108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 225/438] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:18.636074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:18.702412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:18.714293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db4d6d-204f-46a0-a77a-072a3ff8d3b7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:18.764000 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:18.764434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:18.765128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.765411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.765682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.766477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:18.766889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:18.768319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9c7c6-19f9-49c3-91dc-b19aeff71ca3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:18.768425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:18.779147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 214/439] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:25:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:18.785420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:18.808784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b9db-d635-4ab1-ab33-5cf70e8c68bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:18.809432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b9db-d635-4ab1-ab33-5cf70e8c68bd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.809712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b9db-d635-4ab1-ab33-5cf70e8c68bd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.813266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b9db-d635-4ab1-ab33-5cf70e8c68bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.890364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0b9db-d635-4ab1-ab33-5cf70e8c68bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:18.892198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0b9db-d635-4ab1-ab33-5cf70e8c68bd None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:18.907899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527f0b4-b2c7-42d1-947f-e2be032325d9 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:18.942518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcea69-838e-43c2-aa8e-40f76db2daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:18.943167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcea69-838e-43c2-aa8e-40f76db2daa5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:18.943556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcea69-838e-43c2-aa8e-40f76db2daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:18.943834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcea69-838e-43c2-aa8e-40f76db2daa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:18.972734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:18.992676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:19.002881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 226/440] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 19:25:19.009170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b9db-d635-4ab1-ab33-5cf70e8c68bd None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:19.015816 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcea69-838e-43c2-aa8e-40f76db2daa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:19.017220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcea69-838e-43c2-aa8e-40f76db2daa5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:19.118210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b9db-d635-4ab1-ab33-5cf70e8c68bd None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:19.125760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 215/441] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:19.131751 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcea69-838e-43c2-aa8e-40f76db2daa5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:19.153447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82cfb3-2a2d-490a-b322-bcffac9355fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:19.154329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82cfb3-2a2d-490a-b322-bcffac9355fe None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.154606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82cfb3-2a2d-490a-b322-bcffac9355fe None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.154875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82cfb3-2a2d-490a-b322-bcffac9355fe None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.156066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82cfb3-2a2d-490a-b322-bcffac9355fe None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:19.157491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82cfb3-2a2d-490a-b322-bcffac9355fe None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:19.159362 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 227/442] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:19.164750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82cfb3-2a2d-490a-b322-bcffac9355fe None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:19.194827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:19.237712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:19.242377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcea69-838e-43c2-aa8e-40f76db2daa5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:19.276144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82cfb3-2a2d-490a-b322-bcffac9355fe None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:19.276309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b21a-b896-4380-b103-7e47e040538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:19.276961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b21a-b896-4380-b103-7e47e040538e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.277236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b21a-b896-4380-b103-7e47e040538e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.277500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b21a-b896-4380-b103-7e47e040538e None admin] PATH_INFO: `/v3/projects/d7e62e4fa17345388ed4552283040e34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.278694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2b21a-b896-4380-b103-7e47e040538e None admin] RBAC: Authorizing `identity:get_project(project_id=d7e62e4fa17345388ed4552283040e34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:19.280139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2b21a-b896-4380-b103-7e47e040538e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:19.281846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 216/443] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/projects/d7e62e4fa17345388ed4552283040e34 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:19.287336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b21a-b896-4380-b103-7e47e040538e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:19.313246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8a641-e5f7-4e82-b6bc-b8ca0dddb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:19.314111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a641-e5f7-4e82-b6bc-b8ca0dddb2a7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.314394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a641-e5f7-4e82-b6bc-b8ca0dddb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.314652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a641-e5f7-4e82-b6bc-b8ca0dddb2a7 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.315854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8a641-e5f7-4e82-b6bc-b8ca0dddb2a7 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:19.317309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8a641-e5f7-4e82-b6bc-b8ca0dddb2a7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:19.323754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 228/444] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:19.323754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255de89-06ec-4b8a-aec2-2d152bef4dc8 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.323754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255de89-06ec-4b8a-aec2-2d152bef4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.323754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255de89-06ec-4b8a-aec2-2d152bef4dc8 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.323754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 229/445] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:19.324649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255de89-06ec-4b8a-aec2-2d152bef4dc8 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:19.384650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b21a-b896-4380-b103-7e47e040538e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:19.409889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:19.419994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e591ce4-b103-4c2f-a221-fcb88b7908a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:19.420863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591ce4-b103-4c2f-a221-fcb88b7908a5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.421143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591ce4-b103-4c2f-a221-fcb88b7908a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.421411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e591ce4-b103-4c2f-a221-fcb88b7908a5 None admin] PATH_INFO: `/v3/groups/d31a486d208c4af0bab6aed950e9b559` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.422728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e591ce4-b103-4c2f-a221-fcb88b7908a5 None admin] RBAC: Authorizing `identity:get_group(group_id=d31a486d208c4af0bab6aed950e9b559)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:19.424219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e591ce4-b103-4c2f-a221-fcb88b7908a5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:19.425844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 217/446] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/groups/d31a486d208c4af0bab6aed950e9b559 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:19.427040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4eeff-3178-49b2-90d6-ddf5766f6aaa None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.427323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4eeff-3178-49b2-90d6-ddf5766f6aaa None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.427602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4eeff-3178-49b2-90d6-ddf5766f6aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.431070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255de89-06ec-4b8a-aec2-2d152bef4dc8 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:19.444350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-42f4eeff-3178-49b2-90d6-ddf5766f6aaa None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:19.445559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-42f4eeff-3178-49b2-90d6-ddf5766f6aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:19.467031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:19.467664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.467962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.468237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.469074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] RBAC: Adding query filter params (group.id=d31a486d208c4af0bab6aed950e9b559, role.id=048795d190224624ad8e995082b0faa0, scope.project.id=d7e62e4fa17345388ed4552283040e34) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:19.469386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:19.470844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:19.473685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:19.477202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 230/447] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/role_assignments?group.id=d31a486d208c4af0bab6aed950e9b559&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=048795d190224624ad8e995082b0faa0 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:19.478307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:19.527289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 218/448] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:19.551040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4eeff-3178-49b2-90d6-ddf5766f6aaa None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:19.595581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cf467-d4ef-42ca-bf65-c03e8d57a27b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:19.638104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:19.638104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.638104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.639554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.640125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] RBAC: Adding query filter params (group.id=d31a486d208c4af0bab6aed950e9b559, role.id=1cafdd847d454019a89ce61428b4a863, scope.project.id=d7e62e4fa17345388ed4552283040e34) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:19.640440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:19.641894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:19.654014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 231/449] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/role_assignments?group.id=d31a486d208c4af0bab6aed950e9b559&scope.project.id=d7e62e4fa17345388ed4552283040e34&role.id=1cafdd847d454019a89ce61428b4a863 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:19.673613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4eeff-3178-49b2-90d6-ddf5766f6aaa None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:19.700877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:19.713146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012318e4-101e-4bdc-9b8f-91f0cfd458dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:19.714051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012318e4-101e-4bdc-9b8f-91f0cfd458dc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.714336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012318e4-101e-4bdc-9b8f-91f0cfd458dc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.714608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012318e4-101e-4bdc-9b8f-91f0cfd458dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.726087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012318e4-101e-4bdc-9b8f-91f0cfd458dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-012318e4-101e-4bdc-9b8f-91f0cfd458dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:19.734081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:19.735061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:19.735980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 219/450] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:19.741554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:19.807328 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:19.846687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489a4ee-766e-4057-b9ec-8a80fd4f3c88 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:19.882974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:19.883625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:19.883911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:19.884169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:19.884972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:19.885276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:19.886686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:19.895089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 232/451] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:19.900892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012318e4-101e-4bdc-9b8f-91f0cfd458dc None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.017804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012318e4-101e-4bdc-9b8f-91f0cfd458dc None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.059233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32566-ae9f-433d-8ff8-7efaf679c916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.059659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32566-ae9f-433d-8ff8-7efaf679c916 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.059937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32566-ae9f-433d-8ff8-7efaf679c916 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.060638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec32566-ae9f-433d-8ff8-7efaf679c916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.113923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:20.130523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec32566-ae9f-433d-8ff8-7efaf679c916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:20.131995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec32566-ae9f-433d-8ff8-7efaf679c916 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:20.236097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 220/452] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:20.243660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.344080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba685586-1d64-4b49-8f43-10086441d465 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.369896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:20.379502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbac34-5403-4bce-b8c6-579264c608a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.380382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbac34-5403-4bce-b8c6-579264c608a1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.380665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbac34-5403-4bce-b8c6-579264c608a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.380936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbac34-5403-4bce-b8c6-579264c608a1 None admin] PATH_INFO: `/v3/projects/2c274d3083ff496a9f0346d090423253` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.382206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbac34-5403-4bce-b8c6-579264c608a1 None admin] RBAC: Authorizing `identity:get_project(project_id=2c274d3083ff496a9f0346d090423253)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:20.383653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbac34-5403-4bce-b8c6-579264c608a1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:20.385373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 233/453] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/projects/2c274d3083ff496a9f0346d090423253 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:20.391269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32566-ae9f-433d-8ff8-7efaf679c916 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.472251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:20.496585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec32566-ae9f-433d-8ff8-7efaf679c916 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.531929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169119f1-bf6c-43fc-8315-fce116c80815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.532775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169119f1-bf6c-43fc-8315-fce116c80815 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.533046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169119f1-bf6c-43fc-8315-fce116c80815 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.533316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169119f1-bf6c-43fc-8315-fce116c80815 None admin] PATH_INFO: `/v3/groups/68fc0712294a49aeb1a9d4024dd91780` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.534551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169119f1-bf6c-43fc-8315-fce116c80815 None admin] RBAC: Authorizing `identity:get_group(group_id=68fc0712294a49aeb1a9d4024dd91780)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:20.536014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169119f1-bf6c-43fc-8315-fce116c80815 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:20.537609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 221/454] 10.222.0.61 () {56 vars in 1180 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/groups/68fc0712294a49aeb1a9d4024dd91780 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:20.547303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbac34-5403-4bce-b8c6-579264c608a1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:20.655944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbac34-5403-4bce-b8c6-579264c608a1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:20.690198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb903be2-c0b0-422a-a07f-57c87573b650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:20.690825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903be2-c0b0-422a-a07f-57c87573b650 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:20.691110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903be2-c0b0-422a-a07f-57c87573b650 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:20.691390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb903be2-c0b0-422a-a07f-57c87573b650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:20.692223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb903be2-c0b0-422a-a07f-57c87573b650 None admin] RBAC: Adding query filter params (group.id=68fc0712294a49aeb1a9d4024dd91780, role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=2c274d3083ff496a9f0346d090423253) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:20.692529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb903be2-c0b0-422a-a07f-57c87573b650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:20.693998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb903be2-c0b0-422a-a07f-57c87573b650 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:20.699854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 234/455] 10.222.0.61 () {56 vars in 1376 bytes} [Fri Jul 1 19:25:20 2022] GET /identity/v3/role_assignments?group.id=68fc0712294a49aeb1a9d4024dd91780&scope.project.id=2c274d3083ff496a9f0346d090423253&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:23.048872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa1762-5e6e-4966-b55d-f104bd25cdb5 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.049416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa1762-5e6e-4966-b55d-f104bd25cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.049416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa1762-5e6e-4966-b55d-f104bd25cdb5 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.054460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 222/456] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:23.056303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c72de0-f69c-4443-9e67-814c77d55b19 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.057125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c72de0-f69c-4443-9e67-814c77d55b19 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.057595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c72de0-f69c-4443-9e67-814c77d55b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.086943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-09c72de0-f69c-4443-9e67-814c77d55b19 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:23.088173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-09c72de0-f69c-4443-9e67-814c77d55b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:23.164924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:23.184389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 235/457] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:23.231098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa1762-5e6e-4966-b55d-f104bd25cdb5 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:23.334154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9fba0-34e9-42ed-a9b9-37843c8da2fd None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.334761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9fba0-34e9-42ed-a9b9-37843c8da2fd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.335242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9fba0-34e9-42ed-a9b9-37843c8da2fd None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.337387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 236/458] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:23.342639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c972c2-dc2e-4173-bcc0-595b54202792 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.343225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c972c2-dc2e-4173-bcc0-595b54202792 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.343706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c972c2-dc2e-4173-bcc0-595b54202792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.376121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-71c972c2-dc2e-4173-bcc0-595b54202792 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:23.377322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-71c972c2-dc2e-4173-bcc0-595b54202792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:23.395880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa1762-5e6e-4966-b55d-f104bd25cdb5 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:23.442278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:23.443082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.443361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.443637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.471066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:23.472912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:23.485730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 237/459] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:23.511144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:23.512085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:23.512942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:23.512942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:23.512942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:23.512942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:23.512942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 223/460] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:23.514475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c972c2-dc2e-4173-bcc0-595b54202792 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:23.518730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:23.525118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:23.619821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c972c2-dc2e-4173-bcc0-595b54202792 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:23.642365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:23.658221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:23.659454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.659934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.660429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.672091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:23.673842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:23.692878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:23.693800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:23.694845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:23.694845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:23.694845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:23.694845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:23.697107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 238/461] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:23.702835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:23.734769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fcda4-e7fe-4c63-bed5-02a4d1e76141 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:23.812506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:23.812506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.812506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.812506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.812967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:23.812967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:23.812967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:23.820962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc2529-9566-4a12-acf8-a2f52a37f78c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:23.824324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 224/462] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:23.830153 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:23.857787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cf679-1385-402b-8e8f-5ee6507f03d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:23.858436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf679-1385-402b-8e8f-5ee6507f03d8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.858724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf679-1385-402b-8e8f-5ee6507f03d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.859006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cf679-1385-402b-8e8f-5ee6507f03d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.859845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cf679-1385-402b-8e8f-5ee6507f03d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:23.860162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cf679-1385-402b-8e8f-5ee6507f03d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:23.861653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cf679-1385-402b-8e8f-5ee6507f03d8 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:23.874799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 239/463] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:23.880979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a934b-0810-4ad4-bd40-d07b6a447455 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.881275 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a934b-0810-4ad4-bd40-d07b6a447455 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.881553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a934b-0810-4ad4-bd40-d07b6a447455 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.883009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 240/464] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:23.883597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a934b-0810-4ad4-bd40-d07b6a447455 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:23.898077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:23.916942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:23.938396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53133117-59c9-499a-b9ff-bd562ae0369c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:23.974460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374397e-554b-473b-9718-f0359441b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:23.975422 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374397e-554b-473b-9718-f0359441b594 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:23.975703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374397e-554b-473b-9718-f0359441b594 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:23.975975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374397e-554b-473b-9718-f0359441b594 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:23.976687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374397e-554b-473b-9718-f0359441b594 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:23.978203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374397e-554b-473b-9718-f0359441b594 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:23.992479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a934b-0810-4ad4-bd40-d07b6a447455 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.002018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 225/465] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:25:23 2022] POST /identity/v3/users => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:24.002018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d0b0-4e8e-46bd-842d-ebaa65ff4430 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.002018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d0b0-4e8e-46bd-842d-ebaa65ff4430 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.002018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565d0b0-4e8e-46bd-842d-ebaa65ff4430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.024059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5565d0b0-4e8e-46bd-842d-ebaa65ff4430 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:24.025798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5565d0b0-4e8e-46bd-842d-ebaa65ff4430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:24.043007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22063b69-0e20-4730-963f-99314b8cd306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.046343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22063b69-0e20-4730-963f-99314b8cd306 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.046918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22063b69-0e20-4730-963f-99314b8cd306 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.047591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22063b69-0e20-4730-963f-99314b8cd306 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.050132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22063b69-0e20-4730-963f-99314b8cd306 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.051955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22063b69-0e20-4730-963f-99314b8cd306 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.079179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 241/466] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:25:23 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:24.081495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800b27-3c88-49d8-947f-367a3434e065 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.082085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800b27-3c88-49d8-947f-367a3434e065 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.082565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7800b27-3c88-49d8-947f-367a3434e065 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.084381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 242/467] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:24.100412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176cae-1a4c-43b8-a5e5-2ebcb29bd524 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.101141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176cae-1a4c-43b8-a5e5-2ebcb29bd524 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.101591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32176cae-1a4c-43b8-a5e5-2ebcb29bd524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.136403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-32176cae-1a4c-43b8-a5e5-2ebcb29bd524 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:24.138168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-32176cae-1a4c-43b8-a5e5-2ebcb29bd524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:24.171514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 226/468] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:24.202439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565d0b0-4e8e-46bd-842d-ebaa65ff4430 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.259125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 243/469] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:24.262226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.284120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32176cae-1a4c-43b8-a5e5-2ebcb29bd524 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.308332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.328312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565d0b0-4e8e-46bd-842d-ebaa65ff4430 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.372558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.373368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.373651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.373924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.385977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.387719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:24.408009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:24.408892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:24.409886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:24.409886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:24.409886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:24.409886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:24.409886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 227/470] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:24.417646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.418131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32176cae-1a4c-43b8-a5e5-2ebcb29bd524 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.453147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.454363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.454856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.455325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.466706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.468517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:24.486937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:24.487838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:24.488672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:24.488672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:24.488672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:24.488672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:24.495416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 244/471] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:24.496893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.525573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159f6ec-5911-46a9-8791-0b6b8d0f1682 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.527214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.564205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.565138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.565471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.565748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.566046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.566777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:24.567081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.568481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.582583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 228/472] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:24.594949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.602360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42631abe-0202-4fa1-852a-5eeabac948ec None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.646307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8af388-cd0f-4f96-a97c-a3926bd04325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.646885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af388-cd0f-4f96-a97c-a3926bd04325 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.647163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af388-cd0f-4f96-a97c-a3926bd04325 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.647438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8af388-cd0f-4f96-a97c-a3926bd04325 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.648163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8af388-cd0f-4f96-a97c-a3926bd04325 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:24.648467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8af388-cd0f-4f96-a97c-a3926bd04325 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.650408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8af388-cd0f-4f96-a97c-a3926bd04325 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.670156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 245/473] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:24.670156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363f8ca-32dc-463d-9181-9a7d0aaab873 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.670156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363f8ca-32dc-463d-9181-9a7d0aaab873 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.670156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363f8ca-32dc-463d-9181-9a7d0aaab873 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.673564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 246/474] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:24.674528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363f8ca-32dc-463d-9181-9a7d0aaab873 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:24.734167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d80275-4689-4713-bfec-81c61de4fea1 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.770630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed0555-04a4-40d4-852d-0680a0b467cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.771627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed0555-04a4-40d4-852d-0680a0b467cb None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.772081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed0555-04a4-40d4-852d-0680a0b467cb None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.772539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed0555-04a4-40d4-852d-0680a0b467cb None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.773431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed0555-04a4-40d4-852d-0680a0b467cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.775167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed0555-04a4-40d4-852d-0680a0b467cb None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.799503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 229/475] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:25:24 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:25:24.801296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49dbcd-2b8c-40ef-8f0a-1b4d2dff2b61 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.801804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49dbcd-2b8c-40ef-8f0a-1b4d2dff2b61 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.802325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49dbcd-2b8c-40ef-8f0a-1b4d2dff2b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.823284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5d49dbcd-2b8c-40ef-8f0a-1b4d2dff2b61 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:24.824882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5d49dbcd-2b8c-40ef-8f0a-1b4d2dff2b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:24.827771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363f8ca-32dc-463d-9181-9a7d0aaab873 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:24.841624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.874340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:24.893784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead22c3-83f8-4893-ae8f-922da4cb9264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:24.894547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead22c3-83f8-4893-ae8f-922da4cb9264 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:24.894829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead22c3-83f8-4893-ae8f-922da4cb9264 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:24.895107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead22c3-83f8-4893-ae8f-922da4cb9264 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:24.895841 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead22c3-83f8-4893-ae8f-922da4cb9264 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:24.900123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead22c3-83f8-4893-ae8f-922da4cb9264 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:24.942136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 247/476] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:25:24 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:24.943712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 230/477] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:24.982067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead22c3-83f8-4893-ae8f-922da4cb9264 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:25.101343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead22c3-83f8-4893-ae8f-922da4cb9264 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.139290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.139972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.140310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.140592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.141372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:25.142800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:25.151654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.sql.core [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 19:25:25.151654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 01 19:25:25.151654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [parameters: {'id': '31c65a8b9fef4b919468c8d6d42f49ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 01 19:25:25.151654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80243) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result.read() Jul 01 19:25:25.168174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return ref.to_dict() Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:25:25.169113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application yield resource Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise self.value Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application session.commit() Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 19:25:25.170056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.session.flush() Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application compat.raise_( Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 19:25:25.170920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:25:25.171789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result.read() Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:25:25.174224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [parameters: {'id': '31c65a8b9fef4b919468c8d6d42f49ee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:25.176183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 01 19:25:25.178287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:25.181310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 248/478] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jul 1 19:25:24 2022] POST /identity/v3/roles => generated 144 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:25.181444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49dbcd-2b8c-40ef-8f0a-1b4d2dff2b61 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:25.299207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49dbcd-2b8c-40ef-8f0a-1b4d2dff2b61 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.345400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fa216-4875-40ea-b5d3-96f6bcfe3730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.346604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa216-4875-40ea-b5d3-96f6bcfe3730 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.347107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa216-4875-40ea-b5d3-96f6bcfe3730 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.347597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fa216-4875-40ea-b5d3-96f6bcfe3730 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.359148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fa216-4875-40ea-b5d3-96f6bcfe3730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-4b1fa216-4875-40ea-b5d3-96f6bcfe3730 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:25.367644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:25.368517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 19:25:25.369370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:25.372047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 231/479] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:25:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:25.377421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:25.433753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:25.490604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff19fc-a638-4378-bb6e-a0fdb7acac45 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:25.525904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb03f3c-bbf1-4854-ac8f-70beee554be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:25.526602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb03f3c-bbf1-4854-ac8f-70beee554be3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:25.526885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb03f3c-bbf1-4854-ac8f-70beee554be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:25.527171 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb03f3c-bbf1-4854-ac8f-70beee554be3 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:25.527960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb03f3c-bbf1-4854-ac8f-70beee554be3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:25.528268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb03f3c-bbf1-4854-ac8f-70beee554be3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:25.529658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb03f3c-bbf1-4854-ac8f-70beee554be3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:25.542063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 249/480] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:26.527476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac22f-ebcc-41e6-919f-b0ae7d40e619 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:26.528511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac22f-ebcc-41e6-919f-b0ae7d40e619 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:26.528997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac22f-ebcc-41e6-919f-b0ae7d40e619 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:26.530905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 232/481] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:26.535878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fc4b4-c16e-491b-ab8b-281951af9f56 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:26.536725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fc4b4-c16e-491b-ab8b-281951af9f56 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:26.537203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fc4b4-c16e-491b-ab8b-281951af9f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:26.562946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4d6fc4b4-c16e-491b-ab8b-281951af9f56 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:26.564516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4d6fc4b4-c16e-491b-ab8b-281951af9f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:26.638370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 250/482] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:26.670790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425740be-3ea7-45e3-ac70-b7e70b6ce963 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:26.671353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425740be-3ea7-45e3-ac70-b7e70b6ce963 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:26.671810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425740be-3ea7-45e3-ac70-b7e70b6ce963 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:26.672919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fc4b4-c16e-491b-ab8b-281951af9f56 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:26.673462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 233/483] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:26.679859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674869-4289-4090-908c-e49a1f8b0452 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:26.680386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674869-4289-4090-908c-e49a1f8b0452 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:26.680853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc674869-4289-4090-908c-e49a1f8b0452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:26.701137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bc674869-4289-4090-908c-e49a1f8b0452 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:26.703076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bc674869-4289-4090-908c-e49a1f8b0452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:26.705392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:26.739829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:26.786138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 234/484] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:26.803934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674869-4289-4090-908c-e49a1f8b0452 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:26.869208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fc4b4-c16e-491b-ab8b-281951af9f56 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:26.933749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f59d3-a293-4ef7-9fac-8faac997b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:26.934574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f59d3-a293-4ef7-9fac-8faac997b63d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:26.934856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f59d3-a293-4ef7-9fac-8faac997b63d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:26.935132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f59d3-a293-4ef7-9fac-8faac997b63d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:26.954886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f59d3-a293-4ef7-9fac-8faac997b63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-691f59d3-a293-4ef7-9fac-8faac997b63d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:26.971530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:26.972492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:26.973281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:26.974200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 251/485] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:26.981612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f59d3-a293-4ef7-9fac-8faac997b63d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:27.001736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc674869-4289-4090-908c-e49a1f8b0452 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:27.068491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91020a2a-1c1d-4b41-90c5-a1aa6afb9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:27.069301 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91020a2a-1c1d-4b41-90c5-a1aa6afb9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.069579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91020a2a-1c1d-4b41-90c5-a1aa6afb9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.069851 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91020a2a-1c1d-4b41-90c5-a1aa6afb9fd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.090293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:27.095884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91020a2a-1c1d-4b41-90c5-a1aa6afb9fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-91020a2a-1c1d-4b41-90c5-a1aa6afb9fd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:27.106465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:27.107589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:27.108421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 235/486] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:27.116300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91020a2a-1c1d-4b41-90c5-a1aa6afb9fd3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:27.156684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:27.162954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f59d3-a293-4ef7-9fac-8faac997b63d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:27.233018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:27.233834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.234126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.234396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.235246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:27.235552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:27.237859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:27.253237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 252/487] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:27.255065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:27.345811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91020a2a-1c1d-4b41-90c5-a1aa6afb9fd3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:27.407924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:27.408599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.408877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.409151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.410923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:27.411228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:27.412609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:27.429270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 236/488] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:27.434916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:27.436338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba141b3-004e-4dfc-9fdc-493684dd566d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:27.474673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a887e2-17cb-4541-866a-8b37c179bf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:27.475466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a887e2-17cb-4541-866a-8b37c179bf75 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.475746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a887e2-17cb-4541-866a-8b37c179bf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.476023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a887e2-17cb-4541-866a-8b37c179bf75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.492002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a887e2-17cb-4541-866a-8b37c179bf75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:27.493490 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a887e2-17cb-4541-866a-8b37c179bf75 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-06a887e2-17cb-4541-866a-8b37c179bf75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:27.511254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:27.512141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:27.512972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:27.512972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:27.512972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:27.512972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:27.512972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 253/489] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:27.514207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a6eee-d8dc-47ac-8729-563bd6c9d275 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.517503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a6eee-d8dc-47ac-8729-563bd6c9d275 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.517503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a6eee-d8dc-47ac-8729-563bd6c9d275 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.520255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 254/490] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:27.521025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a6eee-d8dc-47ac-8729-563bd6c9d275 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:27.533818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:27.539729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:27.590889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adac8da-172e-4af0-a887-6c8d42fa4a63 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:27.633382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5e5d-24b3-4709-a091-587694ce1c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:27.634481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5e5d-24b3-4709-a091-587694ce1c0b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.634879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5e5d-24b3-4709-a091-587694ce1c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.635476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5e5d-24b3-4709-a091-587694ce1c0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.639724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a6eee-d8dc-47ac-8729-563bd6c9d275 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:27.647468 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5e5d-24b3-4709-a091-587694ce1c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:27.649079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5e5d-24b3-4709-a091-587694ce1c0b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-638e5e5d-24b3-4709-a091-587694ce1c0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:27.667819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:27.668777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:27.669618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:27.669618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:27.669618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:27.669618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:27.669618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 237/491] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:27.674823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7855-2ddf-4258-80e0-85bc79e65626 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.674823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7855-2ddf-4258-80e0-85bc79e65626 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.674823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e7855-2ddf-4258-80e0-85bc79e65626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.679224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31538f3e-70f9-43a1-af4d-8844b0d9312d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:27.680209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538f3e-70f9-43a1-af4d-8844b0d9312d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.680209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538f3e-70f9-43a1-af4d-8844b0d9312d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.680486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31538f3e-70f9-43a1-af4d-8844b0d9312d None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.681184 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31538f3e-70f9-43a1-af4d-8844b0d9312d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:27.681493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31538f3e-70f9-43a1-af4d-8844b0d9312d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:27.682898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31538f3e-70f9-43a1-af4d-8844b0d9312d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:27.692092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-489e7855-2ddf-4258-80e0-85bc79e65626 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:27.693230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-489e7855-2ddf-4258-80e0-85bc79e65626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:27.698967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 255/492] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:27.698967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef086077-ede7-4d27-8a78-3d86fba841c5 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.698967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef086077-ede7-4d27-8a78-3d86fba841c5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.698967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef086077-ede7-4d27-8a78-3d86fba841c5 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.698967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 256/493] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:27.698967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef086077-ede7-4d27-8a78-3d86fba841c5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:27.771080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 238/494] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:27.771893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7855-2ddf-4258-80e0-85bc79e65626 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:27.783422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:27.811011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef086077-ede7-4d27-8a78-3d86fba841c5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:27.830351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:27.848582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c08ac-06f4-421a-a3a0-193b921fd8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:27.849241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c08ac-06f4-421a-a3a0-193b921fd8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.849532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c08ac-06f4-421a-a3a0-193b921fd8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.849792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c08ac-06f4-421a-a3a0-193b921fd8c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.850557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c08ac-06f4-421a-a3a0-193b921fd8c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:27.850863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c08ac-06f4-421a-a3a0-193b921fd8c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:27.852236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c08ac-06f4-421a-a3a0-193b921fd8c2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:27.864131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 257/495] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:27.870152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ff9b-6f54-4599-8628-691ab5bef41f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.870454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ff9b-6f54-4599-8628-691ab5bef41f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.870730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ff9b-6f54-4599-8628-691ab5bef41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.887912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f920ff9b-6f54-4599-8628-691ab5bef41f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:27.889025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f920ff9b-6f54-4599-8628-691ab5bef41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:27.893000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e7855-2ddf-4258-80e0-85bc79e65626 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:27.930046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:27.930871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:27.931206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:27.931480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:27.938876 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:27.940344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:27.956201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:27.957133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:27.958063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:27.958568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 258/496] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:27.962611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 239/497] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:25:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:27.963539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:27.973967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ff9b-6f54-4599-8628-691ab5bef41f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.038147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.072420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b74394-15f9-41ab-89a9-19b5cae3f690 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.075732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.084700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ff9b-6f54-4599-8628-691ab5bef41f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.111185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.111990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.112272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.112544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.120436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.120853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddebcf6-d225-459e-9f90-e085ac23d9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.121650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddebcf6-d225-459e-9f90-e085ac23d9bf None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.121922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.122056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddebcf6-d225-459e-9f90-e085ac23d9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.122225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddebcf6-d225-459e-9f90-e085ac23d9bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.132686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddebcf6-d225-459e-9f90-e085ac23d9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:28.136932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:28.137812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 240/498] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:28.143395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-eddebcf6-d225-459e-9f90-e085ac23d9bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:28.144027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:28.144807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 259/499] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:28.145581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddebcf6-d225-459e-9f90-e085ac23d9bf None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.243358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58e4d9-2c88-497b-863e-88e780a79e40 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.245836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddebcf6-d225-459e-9f90-e085ac23d9bf None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.269295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.279081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.279749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.280033 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.280307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.280766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a57ce8-49ba-476c-97ff-c690ff8fa96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.281141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:28.281446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.281561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57ce8-49ba-476c-97ff-c690ff8fa96e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.281847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57ce8-49ba-476c-97ff-c690ff8fa96e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.282155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a57ce8-49ba-476c-97ff-c690ff8fa96e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.282942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.293014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a57ce8-49ba-476c-97ff-c690ff8fa96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-d9a57ce8-49ba-476c-97ff-c690ff8fa96e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:28.300829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:28.301728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:28.302547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 260/500] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:28.303723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417688e-a76f-43e2-9e66-599c67dfccc9 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.303723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417688e-a76f-43e2-9e66-599c67dfccc9 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.303864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417688e-a76f-43e2-9e66-599c67dfccc9 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.307078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 261/501] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:28.307078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417688e-a76f-43e2-9e66-599c67dfccc9 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.319994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 241/502] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:28.320871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.343554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.412954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417688e-a76f-43e2-9e66-599c67dfccc9 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.422864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad1979-d4c8-4388-9b97-a6c6f84ae296 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.447240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f0314-4226-4677-9da5-2104b772e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.447901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0314-4226-4677-9da5-2104b772e130 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.448181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0314-4226-4677-9da5-2104b772e130 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.448453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f0314-4226-4677-9da5-2104b772e130 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.449302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f0314-4226-4677-9da5-2104b772e130 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:28.449610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f0314-4226-4677-9da5-2104b772e130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.451111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f0314-4226-4677-9da5-2104b772e130 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.456197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.456871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.457152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.457428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.458216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:28.458523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.459903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.469249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 242/503] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:28.470064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.492250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 262/504] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:28.493598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fedc56-0cc0-45ad-b157-dff9b09c619e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.493888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fedc56-0cc0-45ad-b157-dff9b09c619e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.494197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fedc56-0cc0-45ad-b157-dff9b09c619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.510661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-a8fedc56-0cc0-45ad-b157-dff9b09c619e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:28.511858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a8fedc56-0cc0-45ad-b157-dff9b09c619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:28.547198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.556116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.573439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2599842-03fd-44c5-8375-f6c14c4c9f84 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.580708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 263/505] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:28.581535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fedc56-0cc0-45ad-b157-dff9b09c619e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.606274 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.606952 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.607240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.607513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.608288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:28.608593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.609986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.618055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 243/506] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:28.618872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.687017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fedc56-0cc0-45ad-b157-dff9b09c619e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.721003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071eb6a-7273-48f6-95ef-4923fdbfff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.721541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7e235-4fa5-48f0-82e8-9a967e89d7df None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.721675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071eb6a-7273-48f6-95ef-4923fdbfff77 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.721907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071eb6a-7273-48f6-95ef-4923fdbfff77 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.722197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071eb6a-7273-48f6-95ef-4923fdbfff77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.754566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.755356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.755635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.755908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.761844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.772405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.773894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.777585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.790723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071eb6a-7273-48f6-95ef-4923fdbfff77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:28.792229 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071eb6a-7273-48f6-95ef-4923fdbfff77 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:28.793399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:28.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:28.795144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:28.795144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:28.795144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:28.795144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:28.799292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 244/507] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:28.799973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.893369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 264/508] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:28.894231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071eb6a-7273-48f6-95ef-4923fdbfff77 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:28.899750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785996ed-27c5-4bef-90c4-1d33819baaea None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.932605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0c91-254b-4d1a-8bde-e764d207fb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:28.933248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0c91-254b-4d1a-8bde-e764d207fb3c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:28.933533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0c91-254b-4d1a-8bde-e764d207fb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:28.933808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f0c91-254b-4d1a-8bde-e764d207fb3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:28.961372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:28.990759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071eb6a-7273-48f6-95ef-4923fdbfff77 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:28.996132 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.003441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0c91-254b-4d1a-8bde-e764d207fb3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.005000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f0c91-254b-4d1a-8bde-e764d207fb3c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.024028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.024860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.025142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.025414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.035337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.036789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:29.055373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:29.056283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:29.057121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:29.057121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:29.057121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:29.057121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:29.057121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 265/509] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:29.057782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.109154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 245/510] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:29.110029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0c91-254b-4d1a-8bde-e764d207fb3c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.161484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27417f49-98ca-4778-ad7f-71d4851c1585 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.184444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.195120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.196038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.196291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.196530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.204053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.207772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.209255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.210318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f0c91-254b-4d1a-8bde-e764d207fb3c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:29.226663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:29.227664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:29.228607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:29.228607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:29.228607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:29.228607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:29.228607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 266/511] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:29.228918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.250605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.251269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.251806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.252288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.253386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:29.253696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.255172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.267139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 246/512] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:29.267961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.335544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbdaa2-af6b-4114-abea-7af21c74c6ba None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.369577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.370403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.370682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.370942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.376524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202af95-2c11-4909-b86e-9c07fe8e663d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.380861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.382346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:29.399626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:29.400629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:29.401570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:29.401570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:29.401570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:29.401570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:29.401570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 267/513] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:29.401833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.413487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.414491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.414775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.415054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.415842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:29.416150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.417539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.429747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 247/514] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:29.430577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.430710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.452248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.503288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edc3fe-7b72-4feb-a6ae-79e926f5309c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.534522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbb597-8044-458b-a222-a23b4774b39d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.537002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.537795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.538104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.538377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.548452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.549909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:29.568360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:29.569581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:29.570456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:29.570456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:29.570456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:29.570456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:29.570672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.571216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 268/515] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:29.571288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.571288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.571288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.571463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.571528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:29.571528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.572754 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.584289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 248/516] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:29.585079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.654615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.659827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.673637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7dcb6-aaa9-48f1-b058-99779b7d496d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.683240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79c70f-a8a6-4bf2-b7b7-6842442c9b72 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.706438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.707223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.707498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.707770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.715603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.716562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.717042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.717214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.717505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.717766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.718526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:29.718832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.720198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.731762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 249/517] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:29.732302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:29.733479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:25:29.734796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:29.735454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.735535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 269/518] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:29.735535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.834204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95818f-6012-41b7-b0f7-726e382febe4 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.834701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeab3b-67f7-40ee-b091-3f42809bed2d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:29.868103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5c5e5-f3e9-4b16-85b9-0662f6f6fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.868806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5c5e5-f3e9-4b16-85b9-0662f6f6fc17 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.869044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:29.869165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5c5e5-f3e9-4b16-85b9-0662f6f6fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.869399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5c5e5-f3e9-4b16-85b9-0662f6f6fc17 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.869864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:29.870098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:29.870197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5c5e5-f3e9-4b16-85b9-0662f6f6fc17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.870372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:29.871097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:29.871397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:29.871581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5c5e5-f3e9-4b16-85b9-0662f6f6fc17 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.872796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:29.879292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.882891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:29.886580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 270/519] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:29.887572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:29.892814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 250/520] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:25:29 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:29.893752 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5c5e5-f3e9-4b16-85b9-0662f6f6fc17 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.006847 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5c5e5-f3e9-4b16-85b9-0662f6f6fc17 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.012169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb90d93-a0b2-4cfa-b099-610671d47aad None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.045627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.046808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.047089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.048007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.051619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.052413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.052703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.052972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.058779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.060285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.066664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.067796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:30.077609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:30.078530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:30.079378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:30.079378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:30.079378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:30.079378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:30.079378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:30.079378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:30.079378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:30.079378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:30.080225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 251/521] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:30.080793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:30.088999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:30.090181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:25:30.091294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:30.092686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 271/522] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:30.093689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.144119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.159852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.192808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6afb5a-65e6-49c0-9187-788e41042214 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.206038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff14299-6c89-48e0-baac-c4fadcab2070 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.229921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.230614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.230888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.231135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.231976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:30.232278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.233722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.243573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.244376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.244660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.244935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.251901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.257042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.257191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 252/523] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:30.257191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:30.268874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:30.269734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:30.270912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 272/524] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:30.274952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.358078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b221123-931f-410d-8d62-a2fc219ed578 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.370056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.379110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1334f-3e65-480a-82cd-f0352f703c7d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.394927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.395670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.395947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.396217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.397003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:30.397307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.398773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.403181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.421477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 253/525] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:30.421477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.423932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.424610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.424892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.425894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.426095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:30.426357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.427815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.450754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 273/526] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:30.451760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.529228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefaeed-9d5f-4021-be1c-b292475f1bb7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.556992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5575f26-7d62-4210-b897-910ac7b2f53d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.563151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27157f0-e4e8-401f-8cc0-9113b89f7776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.563807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27157f0-e4e8-401f-8cc0-9113b89f7776 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.564090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27157f0-e4e8-401f-8cc0-9113b89f7776 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.564366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27157f0-e4e8-401f-8cc0-9113b89f7776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.596211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.596859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.597132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.597386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.598212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:30.598520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.599939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.607051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.623556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 274/527] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:30.623556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.645176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27157f0-e4e8-401f-8cc0-9113b89f7776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.646701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27157f0-e4e8-401f-8cc0-9113b89f7776 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.666531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.734061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bf232-53d2-4438-8445-979fd4b79cb3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.755418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 254/528] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:30.755418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27157f0-e4e8-401f-8cc0-9113b89f7776 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.776265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.776914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.777198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.777469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.778326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=d78ccd9541dc48cfbdfc116dcec91a2f) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:30.778634 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.780062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.786156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 275/529] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/role_assignments?user.id=d78ccd9541dc48cfbdfc116dcec91a2f&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:30.787163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:30.855081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.898201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27157f0-e4e8-401f-8cc0-9113b89f7776 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.909452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f36e9-71f2-4580-a4d0-87e65000884a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:30.911797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:30.949331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089344-52d9-4b49-a94d-2a3513f46e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.950100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089344-52d9-4b49-a94d-2a3513f46e22 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.950523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089344-52d9-4b49-a94d-2a3513f46e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.950859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089344-52d9-4b49-a94d-2a3513f46e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.951446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:30.952584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:30.953082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:30.953550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:30.954831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=ca1a1889e2fb436a86c5e68bf9f1e608) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:30.955216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:30.956747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:30.964342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 276/530] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/role_assignments?user.id=ca1a1889e2fb436a86c5e68bf9f1e608&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:30.965126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:31.073566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089344-52d9-4b49-a94d-2a3513f46e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:31.076806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089344-52d9-4b49-a94d-2a3513f46e22 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:31.168372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1340f3-d32d-451c-ad03-42632ff52cb4 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:31.180812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:31.206199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:31.206989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:31.207346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:31.207563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:31.219219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:31.220673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:31.220905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 255/531] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:31.225764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089344-52d9-4b49-a94d-2a3513f46e22 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:31.239096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:31.239955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:31.241221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:31.241221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:31.241221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:31.241221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:31.241221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 277/532] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:31.246239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:31.265770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:31.337440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089344-52d9-4b49-a94d-2a3513f46e22 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:31.374106 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:31.375311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:31.375798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:31.376316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:31.387673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:31.389460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:31.409113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:31.410035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:31.411058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:31.411058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:31.411058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:31.411058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:31.413036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 256/533] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:31.419083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:31.431407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4887f8d-580e-4134-8f9b-998f88af6f55 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:31.461398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:31.493556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:31.494253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:31.494539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:31.494819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:31.495562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:31.495875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:31.497284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:31.520753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 278/534] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:31.524486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:31.579950 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cc292-adae-4ad1-876f-6fa73b7ec3d7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:31.622025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:31.622798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:31.622980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:31.623234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:31.623957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:31.624260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:31.625973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:31.630741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:31.641260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 257/535] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:31.646770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:31.657602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a62d5-9145-44b5-82f7-1eb769646eb4 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:31.709012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:31.710195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:31.710980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:31.711458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:31.719656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:31.721384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:31.737790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:31.738767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:31.739702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:31.739702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:31.739702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:31.739702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:31.739702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:31.739702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:31.739702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:31.739702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:31.742623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 279/536] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:31.749351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:31.787324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:31.814364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc3be3-52f0-4c46-9c3d-281173ccb15c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:31.852727 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:31.853587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:31.853870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:31.854174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:31.861711 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:31.863622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:31.879974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:31.880870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:31.881884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 258/537] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:31.890827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:31.971213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd9c3f-bc80-42a1-bb35-afa37a9e15be None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:32.037908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:32.038592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.038873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.039144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.039936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:32.040244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:32.042513 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:32.055470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:32.073973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 280/538] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:32.079342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:32.083802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668dae5-362b-4d6e-97ee-7f929fa5fbb3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:32.154918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82b4fc-aaf3-4f28-a5b0-59e9213159a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:32.155889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b4fc-aaf3-4f28-a5b0-59e9213159a2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.156171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b4fc-aaf3-4f28-a5b0-59e9213159a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.156444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82b4fc-aaf3-4f28-a5b0-59e9213159a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.157418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b4fc-aaf3-4f28-a5b0-59e9213159a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:32.158077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b4fc-aaf3-4f28-a5b0-59e9213159a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:32.159582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82b4fc-aaf3-4f28-a5b0-59e9213159a2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:32.177596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 259/539] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:32.178976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a0241-f6fe-4b6b-961f-b95645eec375 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.179265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a0241-f6fe-4b6b-961f-b95645eec375 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.179544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a0241-f6fe-4b6b-961f-b95645eec375 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.181025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 260/540] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:32.183318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a0241-f6fe-4b6b-961f-b95645eec375 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:32.186325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:32.222712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf9202-5ece-45fa-b70b-4deacc101a29 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:32.260550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cd447-cae8-43b0-898f-df987affa7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:32.261203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cd447-cae8-43b0-898f-df987affa7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.261533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cd447-cae8-43b0-898f-df987affa7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.261809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cd447-cae8-43b0-898f-df987affa7c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.262786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cd447-cae8-43b0-898f-df987affa7c7 None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=9fcc425392664c17b72fb4655f8fb7f6) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:32.263095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cd447-cae8-43b0-898f-df987affa7c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:32.264676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cd447-cae8-43b0-898f-df987affa7c7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:32.278316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 281/541] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:32 2022] GET /identity/v3/role_assignments?user.id=9fcc425392664c17b72fb4655f8fb7f6&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:32.279986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fa99d-9eb6-40d3-97bf-d7d5d192c256 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.280279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fa99d-9eb6-40d3-97bf-d7d5d192c256 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.280560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03fa99d-9eb6-40d3-97bf-d7d5d192c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.288724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a0241-f6fe-4b6b-961f-b95645eec375 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:32.301707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d03fa99d-9eb6-40d3-97bf-d7d5d192c256 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:32.303181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d03fa99d-9eb6-40d3-97bf-d7d5d192c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:32.326150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:32.326854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.327133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.327406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.328246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=bfbcf52f970e475c8d7f91d373949ce6) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:32.328557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:32.330048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:32.336978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 261/542] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:32 2022] GET /identity/v3/role_assignments?user.id=bfbcf52f970e475c8d7f91d373949ce6&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:32.371130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:32.385538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 282/543] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:32.409060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:32.498411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:32.540173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b093e00-b169-486a-bdc7-fc5129b9477d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:32.576810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238787-70a4-430b-ac2e-3cf0dd88f785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:32.578296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238787-70a4-430b-ac2e-3cf0dd88f785 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.578577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238787-70a4-430b-ac2e-3cf0dd88f785 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.578854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23238787-70a4-430b-ac2e-3cf0dd88f785 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.590496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23238787-70a4-430b-ac2e-3cf0dd88f785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-23238787-70a4-430b-ac2e-3cf0dd88f785 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:32.598795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:32.599682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:32.600459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 262/544] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:32.607566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fa99d-9eb6-40d3-97bf-d7d5d192c256 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:32.744877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03fa99d-9eb6-40d3-97bf-d7d5d192c256 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:32.799333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:32.799931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:32.800216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:32.800495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:32.801266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:32.801572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:32.802990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:32.818120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 283/545] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:32.823416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238787-70a4-430b-ac2e-3cf0dd88f785 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:32.955586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23238787-70a4-430b-ac2e-3cf0dd88f785 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:32.993971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:32.998368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:32.999640 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.000119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.000582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.017273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.023506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:33.051600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:33.052472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:33.053309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:33.053309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:33.053309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:33.053309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:33.053309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 263/546] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:33.062402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.140618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:33.194501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255fe16-874a-44d1-964a-2b3c57d256aa None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.247286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081b362-e3e2-4cfb-a083-a8b7555e73bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.248372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081b362-e3e2-4cfb-a083-a8b7555e73bd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.248877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081b362-e3e2-4cfb-a083-a8b7555e73bd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.249339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081b362-e3e2-4cfb-a083-a8b7555e73bd None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.250291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081b362-e3e2-4cfb-a083-a8b7555e73bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:33.250807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081b362-e3e2-4cfb-a083-a8b7555e73bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.252373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081b362-e3e2-4cfb-a083-a8b7555e73bd None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:33.269409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 284/547] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:33.275371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.304808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e2f0-074d-4900-8e07-f0305dfeceed None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.306388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e2f0-074d-4900-8e07-f0305dfeceed None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.306679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952e2f0-074d-4900-8e07-f0305dfeceed None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.308086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 285/548] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:33.323740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adb974-83d4-47d3-87a9-acccad139f00 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.324024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adb974-83d4-47d3-87a9-acccad139f00 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.324304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adb974-83d4-47d3-87a9-acccad139f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.371032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-15adb974-83d4-47d3-87a9-acccad139f00 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:33.372255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-15adb974-83d4-47d3-87a9-acccad139f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:33.419353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced223-de83-43e3-b7bf-57028a6de987 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.463062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab69cc-cc03-4d68-a6be-eb4818901580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.464345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab69cc-cc03-4d68-a6be-eb4818901580 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.464823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab69cc-cc03-4d68-a6be-eb4818901580 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.465368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab69cc-cc03-4d68-a6be-eb4818901580 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.485157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab69cc-cc03-4d68-a6be-eb4818901580 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.488651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab69cc-cc03-4d68-a6be-eb4818901580 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:33.514529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 286/549] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-b8ab69cc-cc03-4d68-a6be-eb4818901580 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:33.521970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:33.523391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:33.524458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:33.527279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 264/550] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:33.532451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adb974-83d4-47d3-87a9-acccad139f00 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.575661 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7250-b4e3-413c-9da8-b737ae4ab264 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.576288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7250-b4e3-413c-9da8-b737ae4ab264 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.577965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f7250-b4e3-413c-9da8-b737ae4ab264 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.579818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 265/551] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:33.580708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f7250-b4e3-413c-9da8-b737ae4ab264 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.594571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:33.646324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:33.655662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adb974-83d4-47d3-87a9-acccad139f00 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.691307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045eeca-0350-41df-ac38-696620210658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.692222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045eeca-0350-41df-ac38-696620210658 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.692649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045eeca-0350-41df-ac38-696620210658 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.693067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045eeca-0350-41df-ac38-696620210658 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.694184 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045eeca-0350-41df-ac38-696620210658 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:33.694754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045eeca-0350-41df-ac38-696620210658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.696599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045eeca-0350-41df-ac38-696620210658 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:33.715864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 287/552] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:33.716888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f7250-b4e3-413c-9da8-b737ae4ab264 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.717836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a41bb-fe4f-4396-a01e-86fa6e97b9a8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.718340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a41bb-fe4f-4396-a01e-86fa6e97b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.718813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a41bb-fe4f-4396-a01e-86fa6e97b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.736165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-bc1a41bb-fe4f-4396-a01e-86fa6e97b9a8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:33.737655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bc1a41bb-fe4f-4396-a01e-86fa6e97b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:33.756210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea77f-a680-408e-b6f2-aac238668feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.757027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea77f-a680-408e-b6f2-aac238668feb None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.757325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea77f-a680-408e-b6f2-aac238668feb None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.757574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea77f-a680-408e-b6f2-aac238668feb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.772343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ea77f-a680-408e-b6f2-aac238668feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-5c1ea77f-a680-408e-b6f2-aac238668feb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:33.781646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:33.782959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:33.783881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:33.788448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 266/553] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:33.789336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea77f-a680-408e-b6f2-aac238668feb None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.822227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 288/554] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:33.823780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a41bb-fe4f-4396-a01e-86fa6e97b9a8 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:33.874379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:33.907431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea77f-a680-408e-b6f2-aac238668feb None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.910283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:33.951989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a7d33-87d9-4d83-9f18-bc4c7cccf4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.952900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a7d33-87d9-4d83-9f18-bc4c7cccf4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.953188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a7d33-87d9-4d83-9f18-bc4c7cccf4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.953466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a7d33-87d9-4d83-9f18-bc4c7cccf4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.957425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a41bb-fe4f-4396-a01e-86fa6e97b9a8 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:33.993772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:33.994613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:33.994954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:33.995234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:33.996040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:33.996469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:33.997976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.007008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 289/555] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:34.007914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.049761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a7d33-87d9-4d83-9f18-bc4c7cccf4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.051280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a7d33-87d9-4d83-9f18-bc4c7cccf4c0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.123846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:34.133561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fee95-d719-4f16-9877-f6fe7bb5b5a7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.158029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:34.164638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 267/556] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:34.165768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a7d33-87d9-4d83-9f18-bc4c7cccf4c0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.176152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d56a-707f-41fe-b221-765457c23fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.177475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d56a-707f-41fe-b221-765457c23fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.177848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d56a-707f-41fe-b221-765457c23fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.178237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3d56a-707f-41fe-b221-765457c23fc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.192057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3d56a-707f-41fe-b221-765457c23fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-12a3d56a-707f-41fe-b221-765457c23fc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:34.204066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:34.204980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:34.205798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 290/557] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:34.206508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d56a-707f-41fe-b221-765457c23fc6 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.298176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a7d33-87d9-4d83-9f18-bc4c7cccf4c0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.317267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3d56a-707f-41fe-b221-765457c23fc6 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.343631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.344437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.344716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.344988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.354218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.355312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.355793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.356263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.358196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.360345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.368839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.370734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:34.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:34.382874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:34.383798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:34.383798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:34.383798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:34.383798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:34.383798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 268/558] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:34.384135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:34.396629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:34.397617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:34.398606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:34.398606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:34.398606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:34.398606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:34.401095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 291/559] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:34.402204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.412956 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:34.446471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:34.505659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8cb24-4365-471c-9255-1e356cc76f41 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.512717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cada48-fedb-4c9a-9190-c5cfdd22f9f9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.540809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.541737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.542053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.542487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.543547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:34.544001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.545393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.547499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb372d0-decb-4b43-921d-5b9e21cc27d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.548152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb372d0-decb-4b43-921d-5b9e21cc27d8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.548432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb372d0-decb-4b43-921d-5b9e21cc27d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.548699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb372d0-decb-4b43-921d-5b9e21cc27d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.549412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb372d0-decb-4b43-921d-5b9e21cc27d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:34.549713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb372d0-decb-4b43-921d-5b9e21cc27d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.551122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb372d0-decb-4b43-921d-5b9e21cc27d8 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.553786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 269/560] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:34.554542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.569147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 292/561] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:34.570931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233a80-b60e-4c9e-82ed-3e894c66173c None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.570931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233a80-b60e-4c9e-82ed-3e894c66173c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.571145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04233a80-b60e-4c9e-82ed-3e894c66173c None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.572564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 293/562] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:34.577303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04233a80-b60e-4c9e-82ed-3e894c66173c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.649144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:34.669459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6dcba6-c784-4efc-b59a-84f0458ae94a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.683203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:34.688409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04233a80-b60e-4c9e-82ed-3e894c66173c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.706018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.706690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.706970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.707247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.707973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:34.708277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.709679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.722605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 270/563] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:34.723412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.727056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2ad3f-ce93-4ed5-ac68-05ce825452a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.727874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2ad3f-ce93-4ed5-ac68-05ce825452a7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.728150 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2ad3f-ce93-4ed5-ac68-05ce825452a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.728426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2ad3f-ce93-4ed5-ac68-05ce825452a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.738551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2ad3f-ce93-4ed5-ac68-05ce825452a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.740107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2ad3f-ce93-4ed5-ac68-05ce825452a7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-97d2ad3f-ce93-4ed5-ac68-05ce825452a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:34.757176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:34.758114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:34.759019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:34.759019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:34.759019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:34.759019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:34.759019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 294/564] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:34.759736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12c92-b1b5-4cc5-85b1-eb2a4ebec8a0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.759981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12c92-b1b5-4cc5-85b1-eb2a4ebec8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.760254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12c92-b1b5-4cc5-85b1-eb2a4ebec8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.776112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-97c12c92-b1b5-4cc5-85b1-eb2a4ebec8a0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:34.777279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-97c12c92-b1b5-4cc5-85b1-eb2a4ebec8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:34.820041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5db87-1214-481f-ba67-ab1284bc1f5b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.845457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 295/565] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:34.846789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483789b-5826-4dbf-9d86-31cce9aa8bdd None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.847064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483789b-5826-4dbf-9d86-31cce9aa8bdd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.847356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483789b-5826-4dbf-9d86-31cce9aa8bdd None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.848752 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 296/566] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:34.850673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483789b-5826-4dbf-9d86-31cce9aa8bdd None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.862231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.863354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.863911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.864187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.872715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.874203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:34.888627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:34.889585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 271/567] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:34.890897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:34.901350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:34.922446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:34.952076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483789b-5826-4dbf-9d86-31cce9aa8bdd None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.986418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85886ec-db5a-4f6f-bd20-58a4f85f7b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:34.987217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85886ec-db5a-4f6f-bd20-58a4f85f7b4a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:34.987515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85886ec-db5a-4f6f-bd20-58a4f85f7b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:34.987791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85886ec-db5a-4f6f-bd20-58a4f85f7b4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:34.994566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85886ec-db5a-4f6f-bd20-58a4f85f7b4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:34.994721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b174f-5d66-40dc-9cc0-3546abad62a8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:34.996020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85886ec-db5a-4f6f-bd20-58a4f85f7b4a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-c85886ec-db5a-4f6f-bd20-58a4f85f7b4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:35.009626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:35.010688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 297/568] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4078ca-7863-4917-b817-b81b1931e8f9 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.016397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4078ca-7863-4917-b817-b81b1931e8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.017117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4078ca-7863-4917-b817-b81b1931e8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.028048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.028709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.028990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.029263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.030026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:35.030176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1e4078ca-7863-4917-b817-b81b1931e8f9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:35.030356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.031234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1e4078ca-7863-4917-b817-b81b1931e8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:35.031719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.043112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 272/569] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:35.043995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.121355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 298/570] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:35.122245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4078ca-7863-4917-b817-b81b1931e8f9 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.151699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.161808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda58ab-cc4f-4fb6-8985-68d60731a779 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.163746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.198063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d7e3-4164-46eb-930f-cf0b1740f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.198930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d7e3-4164-46eb-930f-cf0b1740f74d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.199211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d7e3-4164-46eb-930f-cf0b1740f74d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.199487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0d7e3-4164-46eb-930f-cf0b1740f74d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.213017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0d7e3-4164-46eb-930f-cf0b1740f74d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-00d0d7e3-4164-46eb-930f-cf0b1740f74d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:35.220837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:35.221992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 273/571] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:35.223443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d7e3-4164-46eb-930f-cf0b1740f74d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.228204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4078ca-7863-4917-b817-b81b1931e8f9 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.270880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.271802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.272307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.272719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.273786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:35.274282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.275857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.293486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 299/572] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:35.294384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.338874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0d7e3-4164-46eb-930f-cf0b1740f74d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.379663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.380329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.380608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.380885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.381666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:35.382004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.383461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.396234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 274/573] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:35.397023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.398801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.405584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165dace-ac5a-4f70-a606-45ec3879cb07 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.411911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.442547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.443340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.443655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.443929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.451331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.452776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:35.467411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:35.468495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 300/574] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:35.469442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.500557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19fe339-94d5-4767-a4f6-15d601a16810 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.535679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8b03-3961-4706-a134-bbcf56c839bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.536486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8b03-3961-4706-a134-bbcf56c839bf None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.536761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8b03-3961-4706-a134-bbcf56c839bf None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.537027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d8b03-3961-4706-a134-bbcf56c839bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.547236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d8b03-3961-4706-a134-bbcf56c839bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-c73d8b03-3961-4706-a134-bbcf56c839bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:35.555096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:35.556219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:35.557284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 275/575] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:35.561811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8b03-3961-4706-a134-bbcf56c839bf None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.569688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98540193-0ea7-41b8-a086-de281f0e4331 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.608807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.609465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.609748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.610060 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.610829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:35.611138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.612506 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.620793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 301/576] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:35.621560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.638394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.642129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.668744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d8b03-3961-4706-a134-bbcf56c839bf None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.701455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.702327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.702615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.702889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.713576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.715214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.722368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51caa4-9765-4737-bcac-873b83e987e0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:35.731943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:35.732829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:35.733855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:35.733855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:35.733855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:35.733855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:35.733855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 276/577] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:35.734172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.756616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.757266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.757546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.757819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.758696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=6de49ef308324229b81a8fa6f3f84287) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:35.759042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.760486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.766012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 302/578] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/role_assignments?user.id=6de49ef308324229b81a8fa6f3f84287&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:35.766640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.849297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913784e8-28e9-4a5b-bd65-d2f0de3fc05a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.873403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.879667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:35.893086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.893823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.894128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.894401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.895279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:35.895494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becda9bc-b043-4579-ae40-2f59e0fc554b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:35.895595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.897072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.916881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 277/579] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:35.917738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:35.941121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:35.941691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:35.942045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:35.942350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:35.943073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:35.943378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:35.944996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:35.962164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 303/580] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:35.963061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.037303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af385ed2-4cfb-40c2-bb00-75d5e04bbe45 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.071279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6c56-2fde-4b06-a046-2cd6ec6e7e12 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.080298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.081200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.081542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.081878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.094105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.095575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.107772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.108433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.108718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.108999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.109718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:36.110051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.111417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:36.114292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:36.115229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:36.116123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:36.116123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:36.116123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:36.116123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:36.120626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 278/581] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:36.121302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.128318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 304/582] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:36.128318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.130440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.162891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.225697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6719b-245a-4049-bb2b-6da62f57abc2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.238079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6615ca-cb38-4286-941c-55e6f9e9ef2e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.262594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.263666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.263952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.264221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.272231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.273026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.273308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.273587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.274991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.276440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.285000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.286525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:36.295477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:36.297500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:36.298397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:36.298397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:36.298397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:36.298397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:36.298397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 305/583] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:36.298397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:36.313182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:36.314421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:36.315795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:36.315795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:36.315795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:36.315795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:36.315795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 279/584] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:36.315795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.366123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.409359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.412292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9311d-1f47-4727-8e63-efd27c402f43 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.424752 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed715440-12f8-4916-8ee5-19038a3f0477 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.447778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.448602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.448888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.449206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.449928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:36.450258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.451634 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.464235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 306/585] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:36.465041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.469623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.470712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.471361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.472609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.481469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.483141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:36.497243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:36.498309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:36.499402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:36.499402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:36.499402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:36.499402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:36.499402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:36.499402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:36.499402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:36.499402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:36.501153 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 280/586] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:36.502072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.576531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b595917-95b7-49a8-aace-811362edbf09 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.595348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.607637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b25132-273e-4ec0-a35c-b7880387fa47 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.615350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.616013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.616408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.616686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.617405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:36.617713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.619246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.636336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 307/587] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:36.636336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.646412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.647084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.647365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.647650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.648360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:36.648668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.650161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.661761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 281/588] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:36.662588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.672395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.743676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a33b-0304-4ea7-a7bf-0d7b08b693e1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.774646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec304f-a9b9-44fd-a241-8075d91b1ce7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.776426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.777234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.777515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.777791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.785255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.786719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:36.801651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:36.802690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 308/589] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:36.803640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.815839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.816837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.817413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.817786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.818616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:36.819018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.820482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.838363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 282/590] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:36.839200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.842440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.908634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:36.909637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f927b37-7f4d-472c-836f-d70a989fa22b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.945078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.945891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.946195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.946468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.947721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb4f17-3794-48b1-8e2f-4b35b957fb04 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:36.953706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:36.955159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:36.969824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:36.970801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:36.971717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 309/591] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:36.972286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:36.988857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:36.990019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:36.990480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:36.990992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:36.998803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.000705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:37.016948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:37.017865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:37.018957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:37.018957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:37.018957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:37.018957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:37.018957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:37.018957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:37.018957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:37.018957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:37.020993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 283/592] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:37.021970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.076054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:37.082915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cdd85-013b-4d09-8ebe-ae7d872df05b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.119511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.120181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.120505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.120757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.121601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:37.121912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.123390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.133203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadeba0-1291-4feb-a6a3-d1077e27b22c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.146441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 310/593] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jul 1 19:25:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:37.146441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.158999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:37.168489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a4fde-2710-40a9-9b12-83ce553623db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.169462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a4fde-2710-40a9-9b12-83ce553623db None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.169809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a4fde-2710-40a9-9b12-83ce553623db None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.170195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a4fde-2710-40a9-9b12-83ce553623db None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/d78ccd9541dc48cfbdfc116dcec91a2f/roles/30dcb64cd7824d3ca9b1918b76d8e443` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.185533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a4fde-2710-40a9-9b12-83ce553623db None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=d78ccd9541dc48cfbdfc116dcec91a2f, role_id=30dcb64cd7824d3ca9b1918b76d8e443)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.187102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a4fde-2710-40a9-9b12-83ce553623db None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.201497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 284/594] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:37 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/d78ccd9541dc48cfbdfc116dcec91a2f/roles/30dcb64cd7824d3ca9b1918b76d8e443 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:37.202598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a4fde-2710-40a9-9b12-83ce553623db None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.281014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddda980-ae0e-44e0-a93b-805da52db8df None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.324252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a4fde-2710-40a9-9b12-83ce553623db None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.330867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.331791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.332212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.333333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.334372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:37.335315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.337907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.364261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.364683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 311/595] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jul 1 19:25:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:37.365704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.369581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.370757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.370757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.371209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:37.371520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.373045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.386251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:37.394038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 285/596] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:37.396438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.442717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:37.477741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236ebf7-3f86-4bcf-8d60-9ae4c30d79c9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.513539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.514365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.514746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.515022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.526423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.527871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.528769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f21ac0-165c-4348-b2dc-58146311b8dc None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:37.547315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:37.548214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:37.549079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:37.549079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:37.549079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:37.549079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:37.549079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 312/597] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:37.549784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.571840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.572725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.573004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.573275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.584387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.586185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:37.604306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:37.605348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:37.606270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:37.606270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:37.606270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:37.606270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:37.610164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 286/598] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:37.611078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.630790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:37.683710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03644864-2f09-4a85-893f-9390582fbf87 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.705932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:37.719075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7fb1e-e609-4532-9f26-5d9162410b7d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.736316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2d020-e3e3-4976-83a6-07952c84bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.737810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2d020-e3e3-4976-83a6-07952c84bffe None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.738128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2d020-e3e3-4976-83a6-07952c84bffe None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.738408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2d020-e3e3-4976-83a6-07952c84bffe None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/ca1a1889e2fb436a86c5e68bf9f1e608/roles/30dcb64cd7824d3ca9b1918b76d8e443` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.760636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2d020-e3e3-4976-83a6-07952c84bffe None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=ca1a1889e2fb436a86c5e68bf9f1e608, role_id=30dcb64cd7824d3ca9b1918b76d8e443)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.762114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2d020-e3e3-4976-83a6-07952c84bffe None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.763251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598aee8-23b4-4729-8577-4831d527bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.764412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598aee8-23b4-4729-8577-4831d527bf69 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.764936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598aee8-23b4-4729-8577-4831d527bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.765769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598aee8-23b4-4729-8577-4831d527bf69 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.766846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598aee8-23b4-4729-8577-4831d527bf69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:37.767225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598aee8-23b4-4729-8577-4831d527bf69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.768546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598aee8-23b4-4729-8577-4831d527bf69 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.782594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 313/599] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:37 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/ca1a1889e2fb436a86c5e68bf9f1e608/roles/30dcb64cd7824d3ca9b1918b76d8e443 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:37.785655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2d020-e3e3-4976-83a6-07952c84bffe None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.793332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 287/600] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:37.794911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cac21-631c-47d0-98e3-e37a474d9ace None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.795195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cac21-631c-47d0-98e3-e37a474d9ace None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.795474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cac21-631c-47d0-98e3-e37a474d9ace None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.797274 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 288/601] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:37.798129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cac21-631c-47d0-98e3-e37a474d9ace None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:37.919714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cac21-631c-47d0-98e3-e37a474d9ace None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.927917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2d020-e3e3-4976-83a6-07952c84bffe None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:37.949379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:37.964339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.965014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.965413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.965914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.975562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.977032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.978948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf3f93-b2a3-4cbe-91b2-acda9d8ec3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:37.979621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf3f93-b2a3-4cbe-91b2-acda9d8ec3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.979906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf3f93-b2a3-4cbe-91b2-acda9d8ec3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.980187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf3f93-b2a3-4cbe-91b2-acda9d8ec3b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.981064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf3f93-b2a3-4cbe-91b2-acda9d8ec3b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:37.981384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf3f93-b2a3-4cbe-91b2-acda9d8ec3b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:37.983141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf3f93-b2a3-4cbe-91b2-acda9d8ec3b3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:37.994219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:37.995135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:37.995991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:37.995991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:37.995991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:37.995991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:37.995991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:37.995991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:37.995991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:37.995991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:37.996406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 314/602] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:37.997440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4185-0d21-4b2a-ba05-efa994d8e37f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:37.997728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4185-0d21-4b2a-ba05-efa994d8e37f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:37.998045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba4185-0d21-4b2a-ba05-efa994d8e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:37.999124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 289/603] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:38.002520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:38.014949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:38.018319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1fba4185-0d21-4b2a-ba05-efa994d8e37f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:38.019667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1fba4185-0d21-4b2a-ba05-efa994d8e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:38.115223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 315/604] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:38.121914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba4185-0d21-4b2a-ba05-efa994d8e37f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:38.136365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aabf06-3d30-4b98-bbcf-c325f38aca8a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:38.184310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:38.186148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:38.186652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:38.187143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:38.196067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:38.198380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:38.217017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:38.218077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:38.218965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:38.218965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:38.218965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:38.218965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:38.218965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:38.218965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:38.218965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:38.218965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:38.221693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 290/605] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:38.223070 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:38.247582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba4185-0d21-4b2a-ba05-efa994d8e37f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:38.250680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:38.298121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:38.299036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:38.299441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:38.299813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:38.300876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:38.301377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:38.302966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:38.306125 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:38.317496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 316/606] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:38.318516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:38.348638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d570d-470f-4d47-a5bc-467dfa812c3c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:38.391182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be30c-d07c-450a-90e7-c9977304b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:38.392296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be30c-d07c-450a-90e7-c9977304b509 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:38.392724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be30c-d07c-450a-90e7-c9977304b509 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:38.393140 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811be30c-d07c-450a-90e7-c9977304b509 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:38.408682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811be30c-d07c-450a-90e7-c9977304b509 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-811be30c-d07c-450a-90e7-c9977304b509 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:38.418982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:38.420059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:38.421075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:38.425998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 291/607] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:38.425998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be30c-d07c-450a-90e7-c9977304b509 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:38.439948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d3624-9051-46a8-b168-4f91c8c85509 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:38.476808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:38.478006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:38.478489 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:38.478987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:38.480164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:38.480669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:38.482365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:38.495975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 317/608] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:38.497247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:38.530185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:38.547119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811be30c-d07c-450a-90e7-c9977304b509 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:38.576020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:38.586506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f54499-206c-43c4-8de3-af019a27df9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:38.587979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54499-206c-43c4-8de3-af019a27df9e None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:38.588459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54499-206c-43c4-8de3-af019a27df9e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:38.588949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54499-206c-43c4-8de3-af019a27df9e None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/9fcc425392664c17b72fb4655f8fb7f6/roles/30dcb64cd7824d3ca9b1918b76d8e443` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:38.604798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f54499-206c-43c4-8de3-af019a27df9e None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=9fcc425392664c17b72fb4655f8fb7f6, role_id=30dcb64cd7824d3ca9b1918b76d8e443)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:38.606701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f54499-206c-43c4-8de3-af019a27df9e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:38.632444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 292/609] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:38 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/9fcc425392664c17b72fb4655f8fb7f6/roles/30dcb64cd7824d3ca9b1918b76d8e443 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:38.632444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f54499-206c-43c4-8de3-af019a27df9e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:38.635356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95c7ec-d943-48e7-8a9a-3a91b9ecac50 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:38.707565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:38.708690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:38.709181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:38.709697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:38.711121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:38.711628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:38.713628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:38.726266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 318/610] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:38.733787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:38.855626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f54499-206c-43c4-8de3-af019a27df9e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:38.866962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:38.893546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0201a4-68f7-429b-bf76-3ff4b8df9234 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:38.906638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff707-cc2d-46fc-8dc7-1bc160d1506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:38.907898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff707-cc2d-46fc-8dc7-1bc160d1506f None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:38.908409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff707-cc2d-46fc-8dc7-1bc160d1506f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:38.908904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff707-cc2d-46fc-8dc7-1bc160d1506f None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/bfbcf52f970e475c8d7f91d373949ce6/roles/30dcb64cd7824d3ca9b1918b76d8e443` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:38.933552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:38.934381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:38.934660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:38.934933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:38.940170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff707-cc2d-46fc-8dc7-1bc160d1506f None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=bfbcf52f970e475c8d7f91d373949ce6, role_id=30dcb64cd7824d3ca9b1918b76d8e443)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:38.941987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff707-cc2d-46fc-8dc7-1bc160d1506f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:38.949455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:38.949455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:38.969357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:38.970549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:38.971671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:38.971671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:38.971671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:38.971671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:38.973801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 319/611] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:38.974937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 293/612] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:38 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/bfbcf52f970e475c8d7f91d373949ce6/roles/30dcb64cd7824d3ca9b1918b76d8e443 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:38.983233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:39.100722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf71f08-0f94-424b-a407-2dc0570f4a48 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:39.138176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:39.138845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:39.139123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:39.139393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:39.140119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:39.140420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:39.141793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:39.150576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:39.157633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 320/613] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:39.165006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff707-cc2d-46fc-8dc7-1bc160d1506f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:39.215111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:39.312476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff707-cc2d-46fc-8dc7-1bc160d1506f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:39.356118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c8838-c78f-4fe6-b7df-fa39efd2691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:39.356923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8838-c78f-4fe6-b7df-fa39efd2691d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:39.357222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8838-c78f-4fe6-b7df-fa39efd2691d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:39.357479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c8838-c78f-4fe6-b7df-fa39efd2691d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:39.366872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c8838-c78f-4fe6-b7df-fa39efd2691d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:39.368363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c8838-c78f-4fe6-b7df-fa39efd2691d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-711c8838-c78f-4fe6-b7df-fa39efd2691d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:39.383084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:39.384042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:39.385456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 294/614] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:39.392349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:39.441750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794690d9-2155-4a7b-b173-271edc4bc188 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:39.442103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794690d9-2155-4a7b-b173-271edc4bc188 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:39.442346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794690d9-2155-4a7b-b173-271edc4bc188 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:39.443974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 295/615] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:39.448999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6d971-480e-45c4-b883-ac1049fa0c51 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:39.449284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6d971-480e-45c4-b883-ac1049fa0c51 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:39.449561 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6d971-480e-45c4-b883-ac1049fa0c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:39.472869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-61b6d971-480e-45c4-b883-ac1049fa0c51 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:39.474187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-61b6d971-480e-45c4-b883-ac1049fa0c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:39.560535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ffea6-79af-4d86-bd68-294771dc7db7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:39.608204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 296/616] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:39.620477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:39.621141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:39.621422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:39.621695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:39.622574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:39.622883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:39.624318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:39.642483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 321/617] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jul 1 19:25:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:39.648455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6d971-480e-45c4-b883-ac1049fa0c51 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:39.650929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:39.679152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:39.720075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:39.768132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bd4b0-d889-4b31-8b08-8c0572dd028a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:39.805434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8a231-aacb-44c9-8cf7-bdd3f94c0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:39.810286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8a231-aacb-44c9-8cf7-bdd3f94c0e23 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:39.810286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8a231-aacb-44c9-8cf7-bdd3f94c0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:39.810286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8a231-aacb-44c9-8cf7-bdd3f94c0e23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:39.824838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8a231-aacb-44c9-8cf7-bdd3f94c0e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-0ff8a231-aacb-44c9-8cf7-bdd3f94c0e23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:39.833089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:39.834058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:39.835114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 322/618] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:39.840480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8a231-aacb-44c9-8cf7-bdd3f94c0e23 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:39.854014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6d971-480e-45c4-b883-ac1049fa0c51 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:39.917211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:39.917929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:39.918229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:39.918502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:39.937886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:39.939364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:39.968007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:39.968962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:39.970421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:39.970421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:39.970421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:39.970421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:39.970421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 297/619] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:39.975313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.040094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8a231-aacb-44c9-8cf7-bdd3f94c0e23 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.054599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:40.087899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:40.094930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0faba-9066-44c5-820d-9998a9aa9451 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.128353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779efdd-816e-463a-b62c-da2e48930847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.129024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779efdd-816e-463a-b62c-da2e48930847 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.129305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779efdd-816e-463a-b62c-da2e48930847 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.129587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779efdd-816e-463a-b62c-da2e48930847 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.130369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779efdd-816e-463a-b62c-da2e48930847 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:40.130667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779efdd-816e-463a-b62c-da2e48930847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.132076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779efdd-816e-463a-b62c-da2e48930847 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.146301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 323/620] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:40.147710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3863-a56d-4e59-9956-ed27406e8929 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.147986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3863-a56d-4e59-9956-ed27406e8929 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.148257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3863-a56d-4e59-9956-ed27406e8929 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.151541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc23cc2-8311-4c72-ad90-8b3febed0703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.152216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23cc2-8311-4c72-ad90-8b3febed0703 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.152502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23cc2-8311-4c72-ad90-8b3febed0703 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.152776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc23cc2-8311-4c72-ad90-8b3febed0703 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.153319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 324/621] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:40.153581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc23cc2-8311-4c72-ad90-8b3febed0703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:40.153889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc23cc2-8311-4c72-ad90-8b3febed0703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.154124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb3863-a56d-4e59-9956-ed27406e8929 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.155303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc23cc2-8311-4c72-ad90-8b3febed0703 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.170545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 298/622] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:40.174594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92d3c-2f30-4092-9551-ec40eee00a64 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.174874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92d3c-2f30-4092-9551-ec40eee00a64 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.175195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92d3c-2f30-4092-9551-ec40eee00a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-61f92d3c-2f30-4092-9551-ec40eee00a64 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:40.195629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-61f92d3c-2f30-4092-9551-ec40eee00a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:40.262212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 299/623] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:40.263054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92d3c-2f30-4092-9551-ec40eee00a64 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.271628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb3863-a56d-4e59-9956-ed27406e8929 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.308040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.308977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.309391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.309670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.321297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.323223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:40.342842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:40.344905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:40.347331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:40.347331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:40.347331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:40.347331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:40.347845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:40.347990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 325/624] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:40.353995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.384927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92d3c-2f30-4092-9551-ec40eee00a64 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.385974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:40.418842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.419662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.419943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.420208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.427219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.428620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:40.443765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:40.444882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:40.445849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:40.445849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:40.445849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:40.445849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:40.445849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:40.445849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:40.445849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:40.445849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:40.449460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 300/625] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:40.450469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.470981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f61b44-6bc5-43d4-a25a-35d1218b5a99 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.518917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a361f4-e078-45fa-8734-316e9ba09a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.519967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a361f4-e078-45fa-8734-316e9ba09a3c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.520666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a361f4-e078-45fa-8734-316e9ba09a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.521102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a361f4-e078-45fa-8734-316e9ba09a3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.536125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a361f4-e078-45fa-8734-316e9ba09a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-a7a361f4-e078-45fa-8734-316e9ba09a3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:40.547288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:40.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:40.549505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:40.554451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 326/626] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:40.554451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a361f4-e078-45fa-8734-316e9ba09a3c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.567623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340712c2-f7ae-4b6a-a964-e66c502870a7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.591254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:40.612441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.613838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.614297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.614976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.615855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:40.616544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.618537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.632719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 301/627] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:40.633896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.660410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:40.670942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a361f4-e078-45fa-8734-316e9ba09a3c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.704994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.705732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.712863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.714261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.715286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:40.716037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.718315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.736470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 327/628] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:40.737485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.750246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a86a9-6cce-4e1f-b498-27747a7b8903 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.787847 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.788805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.789268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.789699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.790780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:40.791246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.792896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.802871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 302/629] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:40.803956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.843895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6945a258-318b-4832-9937-0cbfa04a0e95 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.852430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:40.880766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.881705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.882210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.882520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.891206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.892340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:40.908168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:40.909398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:40.910635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:40.912510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 328/630] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:40.913658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:40.926461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b167-d0e8-411a-be13-49f612bd3070 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:40.927797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:40.964886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd2be6-a802-4225-b0e1-ce300cc9fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:40.966239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2be6-a802-4225-b0e1-ce300cc9fe7b None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:40.966672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2be6-a802-4225-b0e1-ce300cc9fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:40.967092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2be6-a802-4225-b0e1-ce300cc9fe7b None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/6de49ef308324229b81a8fa6f3f84287/roles/30dcb64cd7824d3ca9b1918b76d8e443` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:40.982942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd2be6-a802-4225-b0e1-ce300cc9fe7b None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=6de49ef308324229b81a8fa6f3f84287, role_id=30dcb64cd7824d3ca9b1918b76d8e443)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:40.984430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd2be6-a802-4225-b0e1-ce300cc9fe7b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:40.998920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 303/631] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:40 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/6de49ef308324229b81a8fa6f3f84287/roles/30dcb64cd7824d3ca9b1918b76d8e443 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:41.000070 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd2be6-a802-4225-b0e1-ce300cc9fe7b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.036166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa29f7-10d9-4a72-bc0d-c5e89598b222 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.077872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863ba4f-921b-43e9-a979-66a822a78ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.078868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ba4f-921b-43e9-a979-66a822a78ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.079243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ba4f-921b-43e9-a979-66a822a78ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.079629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863ba4f-921b-43e9-a979-66a822a78ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.092343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863ba4f-921b-43e9-a979-66a822a78ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:41.094088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863ba4f-921b-43e9-a979-66a822a78ac4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-9863ba4f-921b-43e9-a979-66a822a78ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:41.113251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:41.114473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:41.115590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:41.115590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:41.115590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:41.115590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:41.121851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 329/632] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:41.123529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc0ae2-2a63-4a6c-9617-1e802f9d798a None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.123916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc0ae2-2a63-4a6c-9617-1e802f9d798a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.124313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc0ae2-2a63-4a6c-9617-1e802f9d798a None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.129924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 330/633] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:41.129924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc0ae2-2a63-4a6c-9617-1e802f9d798a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.156519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:41.170830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd2be6-a802-4225-b0e1-ce300cc9fe7b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.203149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:41.228167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686d6fc-471e-4e80-bf0f-771a433c102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.228784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d6fc-471e-4e80-bf0f-771a433c102c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.229069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d6fc-471e-4e80-bf0f-771a433c102c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.229344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686d6fc-471e-4e80-bf0f-771a433c102c None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.230236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686d6fc-471e-4e80-bf0f-771a433c102c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:41.230549 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686d6fc-471e-4e80-bf0f-771a433c102c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:41.232120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686d6fc-471e-4e80-bf0f-771a433c102c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:41.251379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc0ae2-2a63-4a6c-9617-1e802f9d798a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.256056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 304/634] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:25:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:41.257538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ac480-f1c8-4251-88cd-556e5766840f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.257834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ac480-f1c8-4251-88cd-556e5766840f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.258143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ac480-f1c8-4251-88cd-556e5766840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.275989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-df3ac480-f1c8-4251-88cd-556e5766840f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:41.277286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-df3ac480-f1c8-4251-88cd-556e5766840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:41.289219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.290260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.290813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.291312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.292222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:41.292719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:41.294364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:41.307652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 331/635] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:41.308842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.353620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 305/636] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:41.354558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ac480-f1c8-4251-88cd-556e5766840f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.422381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efa5a-1cac-48ac-aa28-d62976945d5c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.443236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:41.447849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:41.461382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649aa8a0-db77-4bc4-9107-fb7090d69350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.462101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa8a0-db77-4bc4-9107-fb7090d69350 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.462402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa8a0-db77-4bc4-9107-fb7090d69350 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.462709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649aa8a0-db77-4bc4-9107-fb7090d69350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.464660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ac480-f1c8-4251-88cd-556e5766840f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.503883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.504814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.504924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.505158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.512856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:41.514338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:41.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:41.530658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 306/637] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:41.531587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.549288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aa8a0-db77-4bc4-9107-fb7090d69350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:41.550765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649aa8a0-db77-4bc4-9107-fb7090d69350 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:41.635608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1cd96-d822-4c84-829d-820fffcb2b53 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.653136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 332/638] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:41.654493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50987d-6d31-4e30-b7f2-5d6bcf5bc732 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.654775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50987d-6d31-4e30-b7f2-5d6bcf5bc732 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.655045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50987d-6d31-4e30-b7f2-5d6bcf5bc732 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.656516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 333/639] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:41.657201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50987d-6d31-4e30-b7f2-5d6bcf5bc732 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.674504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3bc84-2d3e-4f41-88bc-28de38b02e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.675305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3bc84-2d3e-4f41-88bc-28de38b02e2d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.675591 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3bc84-2d3e-4f41-88bc-28de38b02e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.675868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3bc84-2d3e-4f41-88bc-28de38b02e2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.682040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:41.685065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:41.688027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3bc84-2d3e-4f41-88bc-28de38b02e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-05d3bc84-2d3e-4f41-88bc-28de38b02e2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:41.696076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:41.697083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:41.697908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 307/640] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:41.699187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abc81a-f4c9-4bab-b6d3-a5bf9d98857c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.699187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abc81a-f4c9-4bab-b6d3-a5bf9d98857c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.699187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abc81a-f4c9-4bab-b6d3-a5bf9d98857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.717610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-64abc81a-f4c9-4bab-b6d3-a5bf9d98857c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:41.718807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-64abc81a-f4c9-4bab-b6d3-a5bf9d98857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:41.776596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50987d-6d31-4e30-b7f2-5d6bcf5bc732 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.801969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 308/641] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:41.801969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abc81a-f4c9-4bab-b6d3-a5bf9d98857c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.812073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.812749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.813037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.813314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.814203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:41.814509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:41.815951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:41.837979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 334/642] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:41.837979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.914692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abc81a-f4c9-4bab-b6d3-a5bf9d98857c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.921854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:41.942701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87666e2-414d-4280-9e91-eacf2beec695 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:41.945506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:41.952099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.952911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.953516 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.953804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.965467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:41.966983 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:41.979011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:41.979680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:41.980071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:41.980353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:41.981106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:41.981413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:41.982797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:41.985204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:41.986185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:41.987657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:41.987657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:41.987657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:41.987657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:41.987657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 309/643] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:41.987657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:41.995679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 335/644] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:41.996347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.099569 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61566202-494a-4547-8ecd-bda79b7b9002 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.105572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae6c8-937a-46fd-af5a-82d0d4743278 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.133884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ac92-3a4f-49c1-a220-902ce0baa5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.134881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ac92-3a4f-49c1-a220-902ce0baa5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.135157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ac92-3a4f-49c1-a220-902ce0baa5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.135425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944ac92-3a4f-49c1-a220-902ce0baa5b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.141281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07956e91-f905-4a0b-bf0a-db469638515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.141932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07956e91-f905-4a0b-bf0a-db469638515a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.142242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07956e91-f905-4a0b-bf0a-db469638515a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.142518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07956e91-f905-4a0b-bf0a-db469638515a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.147511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944ac92-3a4f-49c1-a220-902ce0baa5b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:42.155141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-9944ac92-3a4f-49c1-a220-902ce0baa5b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:42.155551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:42.156563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:42.157554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 310/645] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:42.158300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ac92-3a4f-49c1-a220-902ce0baa5b0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.208359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:42.226383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07956e91-f905-4a0b-bf0a-db469638515a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:42.228107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07956e91-f905-4a0b-bf0a-db469638515a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:42.267758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944ac92-3a4f-49c1-a220-902ce0baa5b0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.303634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.304304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.304585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.304863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.305588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:42.306036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:42.307381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:42.324107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 311/646] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:42.324107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.334878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 336/647] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:42.336095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07956e91-f905-4a0b-bf0a-db469638515a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.381001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:42.435366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094441d5-d604-4f63-98a7-f8b265554a30 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.437043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:42.437779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07956e91-f905-4a0b-bf0a-db469638515a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.471330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.471997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.472277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.472555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.473301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:42.473610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:42.474132 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.475057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:42.475330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.475771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.476456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.483211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 337/648] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:42.483990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.491766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:42.493216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:42.511493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:42.512408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:42.513285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:42.513285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:42.513285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:42.513285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:42.513285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 312/649] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:42.513562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.603686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab8484-7acc-441e-97e8-c908480615f9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.606185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:42.625156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07090ce9-72a4-49a6-97aa-fad98d71d18f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.640726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.641513 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.641793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.642090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.648937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:42.650433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:42.660206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.660996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.661273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.661540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:42.664335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:42.665222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:42.666186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 338/650] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:42.667070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.675943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:42.677685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:42.698013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:42.699109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:42.700156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:42.700156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:42.700156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:42.700156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:42.702132 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 313/651] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:42.702967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.712203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:42.777034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa932b65-4195-4b1b-a7a4-332b578f1da2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.809410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfabe7-d352-4112-aaaf-a36074d2e8ca None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.812151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.812947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.813233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.813510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.825277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:42.826787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:42.844197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:42.844487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:42.845361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:42.846353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:42.846353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:42.846353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:42.846353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:42.846353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 339/652] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:42.846630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.847820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:42.848174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:42.848453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:42.849178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:42.849480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:42.851029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:42.864060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 314/653] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:42.865158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:42.873668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:42.931650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:42.963992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63d1f8-3edb-410e-bde8-54fc405cb323 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:42.978517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd7ada-2502-4501-8c6d-f3dac4988fd4 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.002945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.003597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.003877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.004156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.004932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:43.005238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.006690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.014987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.015654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.016191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.016191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.016984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:43.017219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.018625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.024174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 340/654] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:43.024174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.036671 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 315/655] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:43.041653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.114812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:43.136825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081025f4-a431-48bb-8176-fc5df2e12ea3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.151102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5818fd9c-a6a1-466d-844b-09ebe8419b58 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.170383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.171111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.171395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.171668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.172391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:43.172702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.174072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.175778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:43.184644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.185408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 341/656] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:43.185531 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.185708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.186005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.186253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.193371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.194851 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:43.209618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:43.211523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 316/657] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:43.212791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.286361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e3890-d236-4d13-9fd1-f200b0807d5b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.312414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876a908-1694-447a-b65d-291ed9830e48 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.318628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ef1a4-98a4-4099-a9b6-c701a2b7a91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.319286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef1a4-98a4-4099-a9b6-c701a2b7a91a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.319576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef1a4-98a4-4099-a9b6-c701a2b7a91a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.319862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ef1a4-98a4-4099-a9b6-c701a2b7a91a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.320691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ef1a4-98a4-4099-a9b6-c701a2b7a91a None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=d78ccd9541dc48cfbdfc116dcec91a2f) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:43.321001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ef1a4-98a4-4099-a9b6-c701a2b7a91a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.322523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ef1a4-98a4-4099-a9b6-c701a2b7a91a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.325284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:43.341981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 342/658] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/role_assignments?user.id=d78ccd9541dc48cfbdfc116dcec91a2f&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:43.341981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f229-2da6-4adb-9424-af9967c1b441 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.341981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f229-2da6-4adb-9424-af9967c1b441 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.341981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1f229-2da6-4adb-9424-af9967c1b441 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.341981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 343/659] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:43.341981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1f229-2da6-4adb-9424-af9967c1b441 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.350803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.351712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.351992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.352266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.362257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.364622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:43.381850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:43.382980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:43.384280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 317/660] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:43.385029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.442764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:43.469813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1f229-2da6-4adb-9424-af9967c1b441 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.506419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84bc8b-7347-477b-ad93-d6b16a9a68e0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.508728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a258dfd4-2fba-45b8-b58e-ba60baaa6ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.510070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258dfd4-2fba-45b8-b58e-ba60baaa6ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.510338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258dfd4-2fba-45b8-b58e-ba60baaa6ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.510617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a258dfd4-2fba-45b8-b58e-ba60baaa6ca9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.520566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258dfd4-2fba-45b8-b58e-ba60baaa6ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.522213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a258dfd4-2fba-45b8-b58e-ba60baaa6ca9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-a258dfd4-2fba-45b8-b58e-ba60baaa6ca9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:43.537488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:43.538498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:43.539471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 344/661] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:43.540115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60897-7578-4528-851e-100bb255c0f0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.540194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60897-7578-4528-851e-100bb255c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.540853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60897-7578-4528-851e-100bb255c0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.548376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.549197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.549544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.549823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.550692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:43.551002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.552519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.560418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f3e60897-7578-4528-851e-100bb255c0f0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:43.561649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f3e60897-7578-4528-851e-100bb255c0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:43.573717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 318/662] 10.222.0.61 () {56 vars in 1139 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:43.573717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.624845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:43.637727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 345/663] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:43.638320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60897-7578-4528-851e-100bb255c0f0 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.682896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419d5de-758e-47ed-9b18-b8c978116639 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.686410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:43.720758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.721424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.721803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.722119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.723026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:43.723357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.724800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.742596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 319/664] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:43.742596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.755617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60897-7578-4528-851e-100bb255c0f0 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.789450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.790202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.790481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.790757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.791618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:43.791924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.793354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.814816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 346/665] 10.222.0.61 () {56 vars in 1137 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:43.814816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:43.852632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d4135-b6c2-41fc-a87e-7d887cb10333 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.863353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:43.888381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b392-b45c-4192-a0e9-3f1c92b2c7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.888954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b392-b45c-4192-a0e9-3f1c92b2c7ed None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.889240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b392-b45c-4192-a0e9-3f1c92b2c7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.889519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4b392-b45c-4192-a0e9-3f1c92b2c7ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.918220 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae70913-58ba-4f78-94ef-799e6f388885 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:43.922277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:43.955565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566490d-27e8-42da-9042-a23f02ce35c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:43.956455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566490d-27e8-42da-9042-a23f02ce35c7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:43.956743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566490d-27e8-42da-9042-a23f02ce35c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:43.957102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566490d-27e8-42da-9042-a23f02ce35c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:43.959947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4b392-b45c-4192-a0e9-3f1c92b2c7ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:43.961735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4b392-b45c-4192-a0e9-3f1c92b2c7ed None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:43.968074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566490d-27e8-42da-9042-a23f02ce35c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-9566490d-27e8-42da-9042-a23f02ce35c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:43.976379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:43.977530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:43.978623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 347/666] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:43.979459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566490d-27e8-42da-9042-a23f02ce35c7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.077622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 320/667] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:44.078693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b392-b45c-4192-a0e9-3f1c92b2c7ed None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.105483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566490d-27e8-42da-9042-a23f02ce35c7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:44.116124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:44.142137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:44.144631 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:44.145296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:44.145590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:44.145987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:44.146723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=ca1a1889e2fb436a86c5e68bf9f1e608) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:44.147035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:44.148480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:44.162142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 348/668] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:43 2022] GET /identity/v3/role_assignments?user.id=ca1a1889e2fb436a86c5e68bf9f1e608&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:44.163106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.183327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4b392-b45c-4192-a0e9-3f1c92b2c7ed None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:44.228690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016509b7-2bf0-4c0e-9429-27659bd8d1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:44.229350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016509b7-2bf0-4c0e-9429-27659bd8d1ed None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:44.229749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016509b7-2bf0-4c0e-9429-27659bd8d1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:44.230117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016509b7-2bf0-4c0e-9429-27659bd8d1ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:44.290856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186e36e-b6d2-4d05-8238-89de7b45bcdd None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:44.326434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016509b7-2bf0-4c0e-9429-27659bd8d1ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:44.327904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016509b7-2bf0-4c0e-9429-27659bd8d1ed None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:44.336736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:44.337711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:44.339592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:44.339592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:44.339592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:44.339592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:44.340845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:44.354760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 349/669] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:44.355322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.397848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:44.406062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:44.453639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 321/670] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:44.454840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016509b7-2bf0-4c0e-9429-27659bd8d1ed None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.478406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332b60d-ff6c-4547-8507-90c8308688ce None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:44.516887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:44.517917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:44.518350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:44.518617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:44.529838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:44.531498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:44.550175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:44.551102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:44.552218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:44.552218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:44.552218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:44.552218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:44.552218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 350/671] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:44.553111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.584863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016509b7-2bf0-4c0e-9429-27659bd8d1ed None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:44.620958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:44.621909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:44.622316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:44.622616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:44.633707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:44.635305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:44.657021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:44.657962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:44.658841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:44.658841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:44.658841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:44.658841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:44.659066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:44.659767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 322/672] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:44.660702 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.674847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6752d8b-2430-4976-a20d-73bc1f587a95 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:44.680270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:44.723626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0235566-7944-4307-9727-35625097cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:44.724826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0235566-7944-4307-9727-35625097cd80 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:44.725474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0235566-7944-4307-9727-35625097cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:44.726314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0235566-7944-4307-9727-35625097cd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:44.743511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0235566-7944-4307-9727-35625097cd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:44.745815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0235566-7944-4307-9727-35625097cd80 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-a0235566-7944-4307-9727-35625097cd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:44.769986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:44.771139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:44.772252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:44.772252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:44.772252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:44.772252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:44.774562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 351/673] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:44.775618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0235566-7944-4307-9727-35625097cd80 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.775741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6765c-c764-48ad-abb3-b3e591b56f01 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:44.819213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:44.820493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:44.821151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:44.821705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:44.822621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:44.823128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:44.825655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:44.841192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 323/674] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:44.842385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.891721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0235566-7944-4307-9727-35625097cd80 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:44.926486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:44.927042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:44.927487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:44.927856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:44.928726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:44.929127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:44.930649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:44.938096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:44.939918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:44.946111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 352/675] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:44.947335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:44.971136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaeaef-391d-4a25-a962-9426dac92143 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.014750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.015676 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.016281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.016700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.018104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:45.018568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.020560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.040589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 324/676] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:45.041763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:45.063128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcc7b1-5121-4c29-99fe-e570e06ae8f4 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.103870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.105587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.106046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.106463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.116196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.118904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:45.137671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:45.138831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:45.139950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:45.139950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:45.139950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:45.139950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:45.139950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:45.139950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:45.139950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:45.139950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:45.142957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 353/677] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:45.144260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:45.162738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569649-14e3-47ff-a4b5-9a5053354ae0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.200449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.201328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.201935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.202189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.205878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:45.213289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.215540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.222366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:45.234677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:45.235967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:45.237262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 325/678] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:45.238969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:45.275769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114eb42-8153-4532-89f7-0676123cb08c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.311194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.312194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.312811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.313013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.320273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.321905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:45.336502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:45.337676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:45.338587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:45.338587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:45.338587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:45.338587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:45.338587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:45.338587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:45.338587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:45.338587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:45.339326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 354/679] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:45.340140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:45.364856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbe6bd-e300-47b7-9215-dcab955e0b68 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.415874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.417654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.418144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.418873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.419853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:45.420590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.423324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.440239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 326/680] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:45.441977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:45.459012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf80c-d79f-4430-ae81-f6f44c1db43a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.478943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:45.499878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.500539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.500818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.501089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.502196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:45.502878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.504586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.524568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 355/681] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jul 1 19:25:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:45.527104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:45.532205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:45.586782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0afd0-8241-4444-8b59-5d53f5e9c30a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.620272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b275e0-3718-42f3-8e37-37a6682b9160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.620957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b275e0-3718-42f3-8e37-37a6682b9160 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.621238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b275e0-3718-42f3-8e37-37a6682b9160 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.621514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b275e0-3718-42f3-8e37-37a6682b9160 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.622357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b275e0-3718-42f3-8e37-37a6682b9160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:45.622656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b275e0-3718-42f3-8e37-37a6682b9160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.624085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b275e0-3718-42f3-8e37-37a6682b9160 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.635431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68061d09-240f-4306-982f-7d9057c205ca None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.636387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 327/682] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:45.637600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5b1f3-0ee0-4002-84cb-4984c24ff563 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.637881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5b1f3-0ee0-4002-84cb-4984c24ff563 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.638182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5b1f3-0ee0-4002-84cb-4984c24ff563 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.639607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 328/683] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:45.643635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5b1f3-0ee0-4002-84cb-4984c24ff563 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:45.676319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348531-b632-44ac-b791-f65f730897ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.676971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348531-b632-44ac-b791-f65f730897ef None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.677257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348531-b632-44ac-b791-f65f730897ef None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.677536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76348531-b632-44ac-b791-f65f730897ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.678406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348531-b632-44ac-b791-f65f730897ef None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=9fcc425392664c17b72fb4655f8fb7f6) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:45.678721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348531-b632-44ac-b791-f65f730897ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.680158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76348531-b632-44ac-b791-f65f730897ef None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.685978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 356/684] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:45 2022] GET /identity/v3/role_assignments?user.id=9fcc425392664c17b72fb4655f8fb7f6&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:45.686755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348531-b632-44ac-b791-f65f730897ef None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:45.741342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:45.772957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5b1f3-0ee0-4002-84cb-4984c24ff563 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.792903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:45.820120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ba830-17af-4af4-83ed-7b43fef0f379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.821463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ba830-17af-4af4-83ed-7b43fef0f379 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.822372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ba830-17af-4af4-83ed-7b43fef0f379 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.823096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ba830-17af-4af4-83ed-7b43fef0f379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.829319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76348531-b632-44ac-b791-f65f730897ef None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:45.875705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917ef8d-5505-4f8f-a2fe-996869737483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:45.876368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ef8d-5505-4f8f-a2fe-996869737483 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.876652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ef8d-5505-4f8f-a2fe-996869737483 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.876929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917ef8d-5505-4f8f-a2fe-996869737483 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.879383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ef8d-5505-4f8f-a2fe-996869737483 None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=bfbcf52f970e475c8d7f91d373949ce6) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:45.879383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ef8d-5505-4f8f-a2fe-996869737483 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.881712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b917ef8d-5505-4f8f-a2fe-996869737483 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:45.888584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 357/685] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:45 2022] GET /identity/v3/role_assignments?user.id=bfbcf52f970e475c8d7f91d373949ce6&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:45.889618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653027-ea7a-4890-8f22-b454200b5504 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:45.889906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653027-ea7a-4890-8f22-b454200b5504 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:45.890241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653027-ea7a-4890-8f22-b454200b5504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:45.912589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-90653027-ea7a-4890-8f22-b454200b5504 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:45.913878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-90653027-ea7a-4890-8f22-b454200b5504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:45.938340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ba830-17af-4af4-83ed-7b43fef0f379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:45.940250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ba830-17af-4af4-83ed-7b43fef0f379 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:46.012606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 358/686] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:46.042159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653027-ea7a-4890-8f22-b454200b5504 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.107704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:46.123789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 329/687] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:46.129575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ba830-17af-4af4-83ed-7b43fef0f379 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.155921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:46.191253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653027-ea7a-4890-8f22-b454200b5504 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:46.238607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fff31-1507-4676-bf11-e215fda1b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:46.239797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fff31-1507-4676-bf11-e215fda1b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.240094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fff31-1507-4676-bf11-e215fda1b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.240374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fff31-1507-4676-bf11-e215fda1b3d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.254548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fff31-1507-4676-bf11-e215fda1b3d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:46.264466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ba830-17af-4af4-83ed-7b43fef0f379 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-2e0fff31-1507-4676-bf11-e215fda1b3d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:46.264921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:46.265797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:46.267100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 359/688] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:46.273389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fff31-1507-4676-bf11-e215fda1b3d1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.311893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:46.312938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.313215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.313511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.327600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:46.329544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:46.358459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:46.360916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:46.362152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:46.362152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:46.362152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:46.362152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:46.362152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 330/689] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:46.366550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.422303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:46.433300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fff31-1507-4676-bf11-e215fda1b3d1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:46.475462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eef36-b6bc-4847-aa21-50f595594b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:46.476501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eef36-b6bc-4847-aa21-50f595594b1e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.477052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eef36-b6bc-4847-aa21-50f595594b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.477540 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eef36-b6bc-4847-aa21-50f595594b1e None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.478138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:46.479453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eef36-b6bc-4847-aa21-50f595594b1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:46.480062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eef36-b6bc-4847-aa21-50f595594b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:46.481505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eef36-b6bc-4847-aa21-50f595594b1e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:46.491051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 360/690] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:46.492783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216c5d-872b-46cc-a394-0e7cf588f5be None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.493479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216c5d-872b-46cc-a394-0e7cf588f5be None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.493927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216c5d-872b-46cc-a394-0e7cf588f5be None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.499521 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 361/691] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:46.500681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17216c5d-872b-46cc-a394-0e7cf588f5be None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.523830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866e439-3b04-4d9f-8e20-9553418c20fc None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:46.571313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d341bd-83ab-4180-a19f-fcdeadec7b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:46.572182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d341bd-83ab-4180-a19f-fcdeadec7b45 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.572550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d341bd-83ab-4180-a19f-fcdeadec7b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.572890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d341bd-83ab-4180-a19f-fcdeadec7b45 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.573724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d341bd-83ab-4180-a19f-fcdeadec7b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:46.574116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d341bd-83ab-4180-a19f-fcdeadec7b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:46.575864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d341bd-83ab-4180-a19f-fcdeadec7b45 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:46.592291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 331/692] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:46.594143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26347133-b898-4aa4-9a02-2c1f92172d33 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.594455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26347133-b898-4aa4-9a02-2c1f92172d33 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.594736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26347133-b898-4aa4-9a02-2c1f92172d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.614024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17216c5d-872b-46cc-a394-0e7cf588f5be None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:46.616101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-26347133-b898-4aa4-9a02-2c1f92172d33 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:46.618374 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-26347133-b898-4aa4-9a02-2c1f92172d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:46.655093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:46.656257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.656745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.657234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.668549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:46.670365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:46.688546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:46.689739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:46.690738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:46.690738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:46.690738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:46.690738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:46.692793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 362/693] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:46.693863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.701967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 332/694] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:46.701967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26347133-b898-4aa4-9a02-2c1f92172d33 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.714273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:46.782592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:46.823666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb19b3-6108-45c0-b4c2-ec71cd797a12 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:46.840803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26347133-b898-4aa4-9a02-2c1f92172d33 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:46.865197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:46.866126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.866479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.866838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.874559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:46.876208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:46.880323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:46.881218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:46.881687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:46.882170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:46.883077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:46.883558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:46.885146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:46.891481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:46.892358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:46.893410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 363/695] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:46.894136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.901567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 333/696] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:46.902787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:46.971725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:47.013281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af36ee3-d27c-4650-8ab4-3bce048f85f3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:47.019293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83f144-1f4b-4bc8-b757-c4af214286cf None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:47.032262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:47.062361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:47.063509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:47.064292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:47.065319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:47.066179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:47.067049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:47.067629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:47.068081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:47.069167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:47.069723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:47.071396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:47.079226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:47.081326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:47.086280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 334/697] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:47.087319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:47.110436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:47.111389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:47.112276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:47.112276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:47.112276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:47.112276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:47.114026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 364/698] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:47.115040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:47.211552 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432c488-3b4e-4b78-8e0b-83abda620adc None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:47.235157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e6e54-5a00-4381-8721-ebd8c0f2a584 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:47.249718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:47.250833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:47.251314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:47.251875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:47.259998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:47.261416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:47.263137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:47.275400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:47.276060 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:47.276342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:47.276619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:47.277462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=6de49ef308324229b81a8fa6f3f84287) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:47.277779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:47.279253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:47.281417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:47.282680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:47.283621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:47.285596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 365/699] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:47 2022] GET /identity/v3/role_assignments?user.id=6de49ef308324229b81a8fa6f3f84287&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:47.286452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 335/700] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:25:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:47.286571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:47.291781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:47.350067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:47.413525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fd753-3923-462b-ac38-775c23cd73be None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:47.426178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26561a62-b621-4d6c-9c3f-f31ad4e7e52a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:47.464418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:47.466596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:47.466879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:47.467155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:47.468013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:47.468321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:47.469801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:47.479100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:47.479778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:47.480060 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:47.480336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:47.481073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:47.481380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:47.482792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:47.509202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 366/701] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:47.511486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 336/702] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:25:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:47.516141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:47.518632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:47.581306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:47.647011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572ac7-9a86-469a-9838-996dc5a48c2b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:47.647208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:47.655053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948760e3-d581-4855-afdd-936e30815e69 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:47.690917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ce489-4a96-40a5-b7dd-2093b8407076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:47.691588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ce489-4a96-40a5-b7dd-2093b8407076 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:47.691863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ce489-4a96-40a5-b7dd-2093b8407076 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:47.692133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ce489-4a96-40a5-b7dd-2093b8407076 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:47.693265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ce489-4a96-40a5-b7dd-2093b8407076 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:47.694816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ce489-4a96-40a5-b7dd-2093b8407076 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:47.698723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77df30-b55e-415c-b935-31ad2379f649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:47.699371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77df30-b55e-415c-b935-31ad2379f649 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:47.699647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77df30-b55e-415c-b935-31ad2379f649 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:47.699924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77df30-b55e-415c-b935-31ad2379f649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:47.723056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 367/703] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:25:47 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:47.792403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77df30-b55e-415c-b935-31ad2379f649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:47.793903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77df30-b55e-415c-b935-31ad2379f649 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:47.904918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:47.916850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 337/704] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:47.918163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ce489-4a96-40a5-b7dd-2093b8407076 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.029465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:48.032975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ce489-4a96-40a5-b7dd-2093b8407076 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:48.076542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa02ad9-1c93-4f04-ba22-1dff6429ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:48.077353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02ad9-1c93-4f04-ba22-1dff6429ae02 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.077640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02ad9-1c93-4f04-ba22-1dff6429ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.077917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa02ad9-1c93-4f04-ba22-1dff6429ae02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.094329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa02ad9-1c93-4f04-ba22-1dff6429ae02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:48.096096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa02ad9-1c93-4f04-ba22-1dff6429ae02 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-9aa02ad9-1c93-4f04-ba22-1dff6429ae02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:48.116085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:48.117015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:48.117891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:48.117891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:48.117891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:48.117891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:48.120279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 368/705] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:48.125482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77df30-b55e-415c-b935-31ad2379f649 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.152628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfad7d-1a6c-4466-8ebf-d290698be736 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.153265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfad7d-1a6c-4466-8ebf-d290698be736 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.153748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfad7d-1a6c-4466-8ebf-d290698be736 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.155431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 369/706] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:48.161594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da15e1-7456-46f7-8e62-96cf9c846aa1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.162184 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da15e1-7456-46f7-8e62-96cf9c846aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.162677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da15e1-7456-46f7-8e62-96cf9c846aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.186735 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-33da15e1-7456-46f7-8e62-96cf9c846aa1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:48.188188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-33da15e1-7456-46f7-8e62-96cf9c846aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:48.250276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77df30-b55e-415c-b935-31ad2379f649 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:48.278060 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 370/707] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:48.292572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:48.293823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.294332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.294798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.295703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:48.296215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:48.297767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:48.302427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da15e1-7456-46f7-8e62-96cf9c846aa1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.312379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 338/708] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:48.317300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.416703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:48.437607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:48.462209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da15e1-7456-46f7-8e62-96cf9c846aa1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:48.467883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c5c3f-0e4c-44f8-92f8-f6cdc3407a20 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:48.507747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8a83b-791f-4de3-a3b5-c287773715b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:48.507958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5b783-2c34-4ae7-be69-9c10b4e2cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:48.508549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a83b-791f-4de3-a3b5-c287773715b4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.508831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a83b-791f-4de3-a3b5-c287773715b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.509138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8a83b-791f-4de3-a3b5-c287773715b4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.509757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5b783-2c34-4ae7-be69-9c10b4e2cd02 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.509858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8a83b-791f-4de3-a3b5-c287773715b4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:48.510345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5b783-2c34-4ae7-be69-9c10b4e2cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.510821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5b783-2c34-4ae7-be69-9c10b4e2cd02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.511201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8a83b-791f-4de3-a3b5-c287773715b4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:48.518888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5b783-2c34-4ae7-be69-9c10b4e2cd02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:48.520571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5b783-2c34-4ae7-be69-9c10b4e2cd02 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-b0b8a83b-791f-4de3-a3b5-c287773715b4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:48.526748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:48.527790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:48.528668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 371/709] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:48.530015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad76ab6-81d9-40ad-84bd-cbeedbcc3bdd None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.530015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad76ab6-81d9-40ad-84bd-cbeedbcc3bdd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.530240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad76ab6-81d9-40ad-84bd-cbeedbcc3bdd None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.535846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 372/710] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:48.536641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad76ab6-81d9-40ad-84bd-cbeedbcc3bdd None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-c3d5b783-2c34-4ae7-be69-9c10b4e2cd02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:48.539974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:48.541109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:48.542040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:48.542040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:48.542040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:48.542040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:48.542040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:48.542040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:48.542040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:48.542040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:48.544218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 339/711] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:48.545608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a8fbb-629a-45ff-8d33-28497d13eb56 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.546101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a8fbb-629a-45ff-8d33-28497d13eb56 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.546562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a8fbb-629a-45ff-8d33-28497d13eb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.563618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-2a3a8fbb-629a-45ff-8d33-28497d13eb56 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:48.565066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2a3a8fbb-629a-45ff-8d33-28497d13eb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:48.639039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 340/712] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:48.640193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a8fbb-629a-45ff-8d33-28497d13eb56 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.670931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad76ab6-81d9-40ad-84bd-cbeedbcc3bdd None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:48.713486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:48.714349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.714993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.715375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.716187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:48.716764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:48.718835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:48.725246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 373/713] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:48.726158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.740550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:48.765603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a8fbb-629a-45ff-8d33-28497d13eb56 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:48.802882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:48.807333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:48.808441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.808863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.809299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.810528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:48.811932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:48.814499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:48.830868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 341/714] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:48.833093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.845419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83ca3e-014f-41dd-8ab7-4825dcd8f9d5 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:48.884861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:48.885792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.886108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.886393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.887117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:48.888831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:48.903152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:48.904165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:48.904999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 374/715] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:48.906484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:48.943918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa0146-56f0-4cfd-b746-3a3089349f09 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:48.951105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:48.979638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:48.980309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:48.980592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:48.980870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:48.981585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] RBAC: Adding query filter params (type=network) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:48.981890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:48.983346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:48.988236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:48.989189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 342/716] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:48.990008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:49.019095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb1ff8-791c-43b1-b1b0-d3217243209a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:49.057964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:49.058677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:49.058963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:49.059240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:49.060083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=d78ccd9541dc48cfbdfc116dcec91a2f) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:49.060845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:49.061977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:49.068643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 375/717] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/role_assignments?user.id=d78ccd9541dc48cfbdfc116dcec91a2f&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:49.111490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d16291-6d2c-4fba-9572-600112ebca7f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:49.150267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e03545-4b6f-4675-b61d-21b6124593f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:49.150965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e03545-4b6f-4675-b61d-21b6124593f5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:49.151250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e03545-4b6f-4675-b61d-21b6124593f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:49.151524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e03545-4b6f-4675-b61d-21b6124593f5 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:49.152266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e03545-4b6f-4675-b61d-21b6124593f5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:49.152578 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e03545-4b6f-4675-b61d-21b6124593f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:49.154077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e03545-4b6f-4675-b61d-21b6124593f5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:49.159891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 343/718] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jul 1 19:25:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:49.166121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:49.296686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417ffbe-b850-44c3-965b-ba2eed766001 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:49.332936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824960e2-e8fb-4415-871b-66361e213640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:49.333601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824960e2-e8fb-4415-871b-66361e213640 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:49.333883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824960e2-e8fb-4415-871b-66361e213640 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:49.334195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824960e2-e8fb-4415-871b-66361e213640 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:49.334914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824960e2-e8fb-4415-871b-66361e213640 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:49.335219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824960e2-e8fb-4415-871b-66361e213640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:49.336942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824960e2-e8fb-4415-871b-66361e213640 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:49.343314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 376/719] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jul 1 19:25:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:49.897403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bd22f-562a-4a64-a8fa-aa6029b2e453 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:49.898139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bd22f-562a-4a64-a8fa-aa6029b2e453 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:49.898139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5bd22f-562a-4a64-a8fa-aa6029b2e453 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:49.899669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 344/720] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:49.911683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62088e4f-2b42-4c60-a2f3-e0936b692039 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:49.911998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62088e4f-2b42-4c60-a2f3-e0936b692039 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:49.912239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62088e4f-2b42-4c60-a2f3-e0936b692039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:49.927409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:50.087024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-62088e4f-2b42-4c60-a2f3-e0936b692039 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:50.088259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-62088e4f-2b42-4c60-a2f3-e0936b692039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:50.176371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 377/721] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:50.214360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bd22f-562a-4a64-a8fa-aa6029b2e453 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:50.266421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:50.358639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5bd22f-562a-4a64-a8fa-aa6029b2e453 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:50.366667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca85d-2272-476e-8b6f-3880097b498d None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:50.367556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca85d-2272-476e-8b6f-3880097b498d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:50.368070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ca85d-2272-476e-8b6f-3880097b498d None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:50.369633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 378/722] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:50.374722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2d5c-3c7f-4ad2-812f-4af2759e430a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:50.375236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2d5c-3c7f-4ad2-812f-4af2759e430a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:50.375700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd2d5c-3c7f-4ad2-812f-4af2759e430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:50.393166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74da7-a1a2-4a8c-a2f7-7ed49e631e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:50.393971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74da7-a1a2-4a8c-a2f7-7ed49e631e4e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:50.394260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74da7-a1a2-4a8c-a2f7-7ed49e631e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:50.394589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74da7-a1a2-4a8c-a2f7-7ed49e631e4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:50.410196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-71cd2d5c-3c7f-4ad2-812f-4af2759e430a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:50.411333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-71cd2d5c-3c7f-4ad2-812f-4af2759e430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:50.416702 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d74da7-a1a2-4a8c-a2f7-7ed49e631e4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-99d74da7-a1a2-4a8c-a2f7-7ed49e631e4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:50.425506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:50.426756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:50.427605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:50.431809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 345/723] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:50.432628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74da7-a1a2-4a8c-a2f7-7ed49e631e4e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:50.541115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 379/724] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 19:25:50.579689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2d5c-3c7f-4ad2-812f-4af2759e430a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:50.603706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:50.620746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74da7-a1a2-4a8c-a2f7-7ed49e631e4e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:50.651611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:50.701457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:50.702069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:50.702354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:50.702625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:50.703405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:50.703705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:50.705124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:50.725034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd2d5c-3c7f-4ad2-812f-4af2759e430a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:50.726106 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 346/725] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:50.731180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:50.761482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e34cf-08de-499e-a3b7-6c69de5e09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:50.762358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e34cf-08de-499e-a3b7-6c69de5e09fe None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:50.762639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e34cf-08de-499e-a3b7-6c69de5e09fe None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:50.762914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e34cf-08de-499e-a3b7-6c69de5e09fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:50.781363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e34cf-08de-499e-a3b7-6c69de5e09fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-797e34cf-08de-499e-a3b7-6c69de5e09fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:50.796058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:50.797137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:50.797986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 380/726] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:50.805375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e34cf-08de-499e-a3b7-6c69de5e09fe None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:50.882212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5389f9f-c2d2-489b-adb6-c13e8d5f0740 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:50.932047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e34cf-08de-499e-a3b7-6c69de5e09fe None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:50.942921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:50.944286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:50.944753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:50.946392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:50.974897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:50.976278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:50.980006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:50.989346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:50.990255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:50.991419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:50.993300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:50.994272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:50.995580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:50.997101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:51.014692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:51.015857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:51.016966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:51.016966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:51.016966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:51.016966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:51.019032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 381/727] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:51.020166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:51.020565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 347/728] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:51.024348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:51.044079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:51.206985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6dc3-fda3-46ed-94b1-7c59e94b8014 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:51.222517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d5d39-e9ae-4b52-8fdf-c839b906667e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:51.275476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:51.276199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.276479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.276755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.279204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:51.279870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.280156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.280426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.281152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:51.281456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:51.282859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:51.301410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:51.303645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:51.314557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 348/729] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:51.315434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:51.337134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:51.338094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:51.338987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:51.338987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:51.338987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:51.338987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:51.340681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 382/730] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:51.344395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:51.390332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:51.450919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee331c-979a-421a-a729-f1535e0ab03c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:51.494576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:51.501710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:51.501710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.502190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.502348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.503041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:51.503351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:51.508977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:51.532279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 383/731] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:51.537971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:51.548084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe2a4a-bc88-4ab0-9600-5f2be80f2396 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:51.584143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f630f6-65c1-4c81-8599-04933bae29cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:51.585002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f630f6-65c1-4c81-8599-04933bae29cc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.585597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f630f6-65c1-4c81-8599-04933bae29cc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.585877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f630f6-65c1-4c81-8599-04933bae29cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.594906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f630f6-65c1-4c81-8599-04933bae29cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:51.596665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f630f6-65c1-4c81-8599-04933bae29cc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-84f630f6-65c1-4c81-8599-04933bae29cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:51.613625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:51.614657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:51.615599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 349/732] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:51.617290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609e3b-6f49-4a11-9bc5-d034b6864d8a None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.617290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609e3b-6f49-4a11-9bc5-d034b6864d8a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.617290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55609e3b-6f49-4a11-9bc5-d034b6864d8a None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.622541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 350/733] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:51.622541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55609e3b-6f49-4a11-9bc5-d034b6864d8a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:51.650067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:51.656681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dbb3f-8bff-42fd-91c7-eb8ff872030a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:51.692707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab39d9c-88ee-44b3-a0b5-2e4d56b9427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:51.693876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39d9c-88ee-44b3-a0b5-2e4d56b9427d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.694406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39d9c-88ee-44b3-a0b5-2e4d56b9427d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.694685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab39d9c-88ee-44b3-a0b5-2e4d56b9427d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.702009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab39d9c-88ee-44b3-a0b5-2e4d56b9427d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:51.703450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab39d9c-88ee-44b3-a0b5-2e4d56b9427d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-3ab39d9c-88ee-44b3-a0b5-2e4d56b9427d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:51.719139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:51.720104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:51.721119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 384/734] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:25:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:51.721694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b4ac-3096-47fe-920a-2b35d3838b47 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.722584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b4ac-3096-47fe-920a-2b35d3838b47 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.722584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278b4ac-3096-47fe-920a-2b35d3838b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.735923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55609e3b-6f49-4a11-9bc5-d034b6864d8a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:51.738123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4278b4ac-3096-47fe-920a-2b35d3838b47 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:51.739276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4278b4ac-3096-47fe-920a-2b35d3838b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:51.767871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:51.777500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33003a52-d93b-4e94-819d-2faaafdd93d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:51.778200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33003a52-d93b-4e94-819d-2faaafdd93d0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.778476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33003a52-d93b-4e94-819d-2faaafdd93d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.778744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33003a52-d93b-4e94-819d-2faaafdd93d0 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.779575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33003a52-d93b-4e94-819d-2faaafdd93d0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:51.779887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33003a52-d93b-4e94-819d-2faaafdd93d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:51.781329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33003a52-d93b-4e94-819d-2faaafdd93d0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:51.806257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 351/735] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jul 1 19:25:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:51.806257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586093a-04d2-4eb3-9492-ad70f8aedb27 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.806257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586093a-04d2-4eb3-9492-ad70f8aedb27 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.806257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586093a-04d2-4eb3-9492-ad70f8aedb27 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.806257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 352/736] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:51.806257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586093a-04d2-4eb3-9492-ad70f8aedb27 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:51.814147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 385/737] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:51.815084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b4ac-3096-47fe-920a-2b35d3838b47 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:51.912342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:51.914566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586093a-04d2-4eb3-9492-ad70f8aedb27 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:51.926888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278b4ac-3096-47fe-920a-2b35d3838b47 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:51.948460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a9100-06e4-4784-8512-19cd13ee9ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:51.949153 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a9100-06e4-4784-8512-19cd13ee9ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.949395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a9100-06e4-4784-8512-19cd13ee9ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.949689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a9100-06e4-4784-8512-19cd13ee9ac5 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.950552 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a9100-06e4-4784-8512-19cd13ee9ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:51.950862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a9100-06e4-4784-8512-19cd13ee9ac5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:51.952291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a9100-06e4-4784-8512-19cd13ee9ac5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:51.961272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a2f44-ede6-4549-89fb-c7793448f60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:51.961965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a2f44-ede6-4549-89fb-c7793448f60a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.962249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a2f44-ede6-4549-89fb-c7793448f60a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.962518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a2f44-ede6-4549-89fb-c7793448f60a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.970024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 353/738] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jul 1 19:25:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:51.971340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a3c6-8827-4c3a-9ee0-8164de1b7d6f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:51.971629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a3c6-8827-4c3a-9ee0-8164de1b7d6f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:51.971902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5a3c6-8827-4c3a-9ee0-8164de1b7d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:51.988213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b8c5a3c6-8827-4c3a-9ee0-8164de1b7d6f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:51.989419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b8c5a3c6-8827-4c3a-9ee0-8164de1b7d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:52.028051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:52.034903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a2f44-ede6-4549-89fb-c7793448f60a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:52.036371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a2f44-ede6-4549-89fb-c7793448f60a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:52.062094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 354/739] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:52.063045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5a3c6-8827-4c3a-9ee0-8164de1b7d6f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.122158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:52.138713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 386/740] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:52.140078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a89c5d-6492-4063-ae81-9e693b80a622 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.140579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a89c5d-6492-4063-ae81-9e693b80a622 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.140687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a89c5d-6492-4063-ae81-9e693b80a622 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.142041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 387/741] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:52.142638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a89c5d-6492-4063-ae81-9e693b80a622 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.166420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c5a3c6-8827-4c3a-9ee0-8164de1b7d6f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:52.200378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b88f-9eb5-4317-9126-468d6923c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:52.201184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b88f-9eb5-4317-9126-468d6923c851 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.201470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b88f-9eb5-4317-9126-468d6923c851 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.201750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037b88f-9eb5-4317-9126-468d6923c851 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.212185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037b88f-9eb5-4317-9126-468d6923c851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-2037b88f-9eb5-4317-9126-468d6923c851 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:52.220047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:52.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:52.222294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 355/742] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:52.223023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b88f-9eb5-4317-9126-468d6923c851 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.245884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a89c5d-6492-4063-ae81-9e693b80a622 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:52.256070 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:52.278993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e7efe-1735-4bce-8ba6-92f42bab5351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:52.279632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7efe-1735-4bce-8ba6-92f42bab5351 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.279896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7efe-1735-4bce-8ba6-92f42bab5351 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.280165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7efe-1735-4bce-8ba6-92f42bab5351 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.319742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037b88f-9eb5-4317-9126-468d6923c851 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:52.335181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:52.351467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e7efe-1735-4bce-8ba6-92f42bab5351 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:52.353153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e7efe-1735-4bce-8ba6-92f42bab5351 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:52.355046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558ad-9397-4d37-82a8-3dd7534446fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:52.355813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558ad-9397-4d37-82a8-3dd7534446fd None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.356099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558ad-9397-4d37-82a8-3dd7534446fd None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.356382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154558ad-9397-4d37-82a8-3dd7534446fd None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.357108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154558ad-9397-4d37-82a8-3dd7534446fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:52.358513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154558ad-9397-4d37-82a8-3dd7534446fd None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:52.374777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 356/743] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:25:52 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:52.375586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558ad-9397-4d37-82a8-3dd7534446fd None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.479480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:52.484812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 388/744] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 19:25:52.491309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268dafe-eac6-4868-a450-62dc2401db64 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.491597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268dafe-eac6-4868-a450-62dc2401db64 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.491878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268dafe-eac6-4868-a450-62dc2401db64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.496058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154558ad-9397-4d37-82a8-3dd7534446fd None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:52.509832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d268dafe-eac6-4868-a450-62dc2401db64 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:52.511086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d268dafe-eac6-4868-a450-62dc2401db64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:52.534699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:52.535565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.535846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.536118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.547909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:52.549412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:52.569682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:52.570784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:52.571789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:52.571789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:52.571789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:52.571789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:52.571789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 357/745] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:52.572488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.589858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 389/746] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:52 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 19:25:52.591019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268dafe-eac6-4868-a450-62dc2401db64 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.609173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:52.694811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268dafe-eac6-4868-a450-62dc2401db64 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:52.697867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edef45a-e21d-48f9-a142-1af3c1b6e420 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:52.733281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:52.734213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.734497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.734722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:52.734834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.735389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.735667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.735943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.736698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:52.736985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:52.738567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:52.746034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:52.751642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:52.751782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 358/747] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:52.751782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.756002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:52.770173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:52.771055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:52.771935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:52.771935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:52.771935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:52.771935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:52.771935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 390/748] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:52.772213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.837874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:52.866477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69190a2-eb09-4f19-8ee1-761ef6becdbf None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:52.876315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6ff75-dfad-43ac-92ef-2b897b5a0d0e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:52.903256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:52.903937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.904193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.904478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.905199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:52.905494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:52.907121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:52.911464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9d79-4172-49d9-9f8b-6313e1f2b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:52.912267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9d79-4172-49d9-9f8b-6313e1f2b681 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:52.912648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9d79-4172-49d9-9f8b-6313e1f2b681 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:52.913021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc9d79-4172-49d9-9f8b-6313e1f2b681 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:52.913841 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc9d79-4172-49d9-9f8b-6313e1f2b681 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:52.915366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc9d79-4172-49d9-9f8b-6313e1f2b681 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:52.924517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 359/749] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:52.925388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:52.931641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 391/750] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:25:52 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:25:52.932460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9d79-4172-49d9-9f8b-6313e1f2b681 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.017289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:53.072584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c15bb2-85dc-4d34-97fc-509a4117de36 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.089871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc9d79-4172-49d9-9f8b-6313e1f2b681 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.117211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:53.119791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.121919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.122484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.122771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.132225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.132903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.133184 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.133457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.134279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:53.134473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.134567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.135926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.136019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.149136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 392/751] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:53.149978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:53.156261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:53.157130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:53.158062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:53.158062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:53.158062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:53.158062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:53.158449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 360/752] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:53.159253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.274977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab96c-ba1d-4a58-bf2a-5338e926cec9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.281658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fbc70-f90c-4344-913f-0e06c757cfae None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.299686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:53.320473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.321225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.321462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.321694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.321852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.322986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.323404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.323899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.329686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.331408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.331527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.333352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:53.347034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:53.348112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:53.349081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:53.349081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:53.349081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:53.349081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:53.349081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:53.349081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:53.349081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:53.349081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:53.350850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:53.351849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:53.353078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:53.353078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:53.353078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:53.353078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:53.353078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:53.353078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:53.353078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:53.353078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:53.353518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 361/753] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:53.353865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.355452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 393/754] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:53.360971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.415142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:53.475160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de8fcc-7761-44fe-902e-5838a8c017ac None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.483878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da9bac-6a22-4734-9973-efeeffd2c642 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.517325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.518712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.519198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.519696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.520808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:53.521346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.521789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.522472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.522746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.523020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.523807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:53.523937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.524107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.525673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.538828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 362/755] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:53.540005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.543804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 394/756] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:53.544680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.583645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:53.659261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67bdfe-1b0e-48ec-9536-7a32b10d93a9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.662329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:53.666105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578d99f-792c-4e95-9ffc-0cfaa295b857 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.697200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.698217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.698714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.699045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.706439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.708324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.710813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.712267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.712716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.713129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.714097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:53.714542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.716345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:53.724482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:53.725618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:25:53.726812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:53.731945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 363/757] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:53.733066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.734028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 395/758] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:53.737892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.844367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:53.851033 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b1911-ea63-4dbd-9fa6-edc4cec18e31 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.872599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d4c4-e91e-4b0a-9c0a-b3d993f864ae None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:53.890639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.891410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.891753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.892090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.892989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=bd7b6bcd191f45d39f6c5e5a6bf7646a) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:53.893363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.895126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.901695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 364/759] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/role_assignments?user.id=bd7b6bcd191f45d39f6c5e5a6bf7646a&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:53.902612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:53.932151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:53.932736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:53.933011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:53.933284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:53.934163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=6de49ef308324229b81a8fa6f3f84287) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:53.934475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:53.941269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:53.956907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 396/760] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/role_assignments?user.id=6de49ef308324229b81a8fa6f3f84287&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:54.051880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7097c-97c4-4e83-933e-3fa208262a85 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:54.091955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:54.092650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:54.092927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:54.093201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:54.094087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:54.094397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:54.095884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:54.117818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 365/761] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:54.123609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:54.156665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:54.233402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab7743-38c6-4bdf-9d33-d192af2c231d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:54.268358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:54.269149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:54.269427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:54.269908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:54.280456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:54.281891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:54.299787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:54.300717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:54.301604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:54.301604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:54.301604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:54.301604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:54.301604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 397/762] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:54.307390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:54.327578 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:54.410913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc9234-3385-4322-bd4e-29540832aeaf None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:54.446348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e04fbb-3bff-448e-9310-f6a67dad7eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:54.447024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e04fbb-3bff-448e-9310-f6a67dad7eea None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:54.447312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e04fbb-3bff-448e-9310-f6a67dad7eea None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:54.447587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e04fbb-3bff-448e-9310-f6a67dad7eea None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:54.448337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e04fbb-3bff-448e-9310-f6a67dad7eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:54.448641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e04fbb-3bff-448e-9310-f6a67dad7eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:54.450046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e04fbb-3bff-448e-9310-f6a67dad7eea None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:54.463138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 366/763] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:54.468819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:54.554372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:54.574747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb099d6-2c6a-40fb-bdf9-4f9965874c2c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:54.594915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231dacc-518a-4aa8-9b02-9361c30d964f None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:54.595480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231dacc-518a-4aa8-9b02-9361c30d964f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:54.595769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231dacc-518a-4aa8-9b02-9361c30d964f None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:54.597390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 367/764] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:25:54.602551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac3343-43fc-43fc-bb4c-2f774ceacadb None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:54.602835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac3343-43fc-43fc-bb4c-2f774ceacadb None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:54.603109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac3343-43fc-43fc-bb4c-2f774ceacadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:54.620941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c0ac3343-43fc-43fc-bb4c-2f774ceacadb None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:54.621470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:54.622250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c0ac3343-43fc-43fc-bb4c-2f774ceacadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:54.622360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:54.622571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:54.622847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:54.633202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:54.634797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:54.651999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:54.652922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:54.654204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 398/765] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:54.661092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:54.697413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 368/766] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:25:54.720348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac3343-43fc-43fc-bb4c-2f774ceacadb None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:54.772780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:54.810788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f856a3e-ed6c-4b7d-a9a0-e652cbbe4865 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:54.869008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:54.870852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:54.872472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:54.874170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:54.875335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:54.876746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:54.878417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:54.881657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac3343-43fc-43fc-bb4c-2f774ceacadb None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:54.900527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:54.904463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 399/767] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:54.911235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:54.953453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:54.954291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:54.954568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:54.954834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] PATH_INFO: `/v3/services/network` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:54.955490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:54.956883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:54.988855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:54.989930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:54.990786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:54.992520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 369/768] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:54 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:54.999341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:55.111881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a13292-4cc3-4b24-be62-a14c1db99a48 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:55.130302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:55.145989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983a6d8-f8c5-4f26-9c8c-2c90348c5307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:55.147241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a6d8-f8c5-4f26-9c8c-2c90348c5307 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.147693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a6d8-f8c5-4f26-9c8c-2c90348c5307 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.148024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983a6d8-f8c5-4f26-9c8c-2c90348c5307 None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/d78ccd9541dc48cfbdfc116dcec91a2f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.149265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be0d7-42b9-4ffe-909b-893b942ce501 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:55.150132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983a6d8-f8c5-4f26-9c8c-2c90348c5307 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=d78ccd9541dc48cfbdfc116dcec91a2f, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:55.152582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983a6d8-f8c5-4f26-9c8c-2c90348c5307 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:55.171176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 400/769] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:54 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/d78ccd9541dc48cfbdfc116dcec91a2f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:55.175084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31812193-af8f-4833-b901-5c32592a1fc6 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.175373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31812193-af8f-4833-b901-5c32592a1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.175659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31812193-af8f-4833-b901-5c32592a1fc6 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.183060 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 401/770] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:55.185100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e9e3-7b85-479c-84ae-59cf76b384bb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.185386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e9e3-7b85-479c-84ae-59cf76b384bb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.185796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162e9e3-7b85-479c-84ae-59cf76b384bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.213597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:55.214418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.214707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.214987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.215765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] RBAC: Adding query filter params (name=network) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:55.216072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:55.219732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:55.226041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2162e9e3-7b85-479c-84ae-59cf76b384bb None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:55.229554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2162e9e3-7b85-479c-84ae-59cf76b384bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:55.230563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 370/771] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:25:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:55.235120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:55.330412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:55.342272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 402/772] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:25:55.362716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162e9e3-7b85-479c-84ae-59cf76b384bb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:55.436392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47541f-53b1-41d7-a2ef-2b38cca35fad None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:55.470131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162e9e3-7b85-479c-84ae-59cf76b384bb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:55.472871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:55.473560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.473840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.474132 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.474843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] RBAC: Adding query filter params (type=network) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:55.475144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:55.476528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:55.479233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:55.483008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 371/773] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:25:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:55.489648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:55.512595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:55.513409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.513690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.513997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.514701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:55.516109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:55.531053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:55.533160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:55.535140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:55.539722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 403/774] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jul 1 19:25:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:55.539722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:55.595804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:55.597318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1963da-ee63-4803-8359-71d9c323ca0e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:55.634308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:55.634975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.635351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.635634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.636525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] RBAC: Adding query filter params (interface=public, service_id=bda8a0e02d23439a9270800437535309, region_id=RegionOne) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:55.636840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:55.638336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:55.641757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe457a-b588-4638-8b6b-45dbdcb33c3e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:55.650296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 372/775] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jul 1 19:25:55 2022] GET /identity/v3/endpoints?service_id=bda8a0e02d23439a9270800437535309&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:55.652071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:55.680527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:55.681243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.681530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.681822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.682594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:55.682904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:55.684371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:55.693667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 404/776] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jul 1 19:25:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:55.694943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:55.718134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:55.797848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057194a6-5c04-497d-a875-d034edb84003 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:55.807832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59810187-53e0-4caa-8998-b773d33301bc None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:55.822594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:55.837384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:55.838080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.838369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.838641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.839350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:55.839655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:55.841025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:55.853791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 405/777] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jul 1 19:25:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:55.861712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:55.878769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416fce4-8e59-4495-9301-375fd66ef231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:55.879459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fce4-8e59-4495-9301-375fd66ef231 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:55.879742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fce4-8e59-4495-9301-375fd66ef231 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:55.880016 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416fce4-8e59-4495-9301-375fd66ef231 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:55.880819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416fce4-8e59-4495-9301-375fd66ef231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:55.882397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1416fce4-8e59-4495-9301-375fd66ef231 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:55.894273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 373/778] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:25:55 2022] GET /identity/v3/services => generated 772 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:56.019959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3224db-4df3-4891-a1b8-41e514ecc3a6 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:56.087135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087bdc-bc5e-4766-be9b-e68399e0fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:56.087795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087bdc-bc5e-4766-be9b-e68399e0fe96 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.088077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087bdc-bc5e-4766-be9b-e68399e0fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.088350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087bdc-bc5e-4766-be9b-e68399e0fe96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.089143 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087bdc-bc5e-4766-be9b-e68399e0fe96 None admin] RBAC: Adding query filter params (interface=public, service_id=33cc94f666da4f909f0ab0c3a529fe8d, region_id=RegionOne) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:56.089448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087bdc-bc5e-4766-be9b-e68399e0fe96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:56.090830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087bdc-bc5e-4766-be9b-e68399e0fe96 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:56.104270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 406/779] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jul 1 19:25:55 2022] GET /identity/v3/endpoints?service_id=33cc94f666da4f909f0ab0c3a529fe8d&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:56.109506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416fce4-8e59-4495-9301-375fd66ef231 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:56.247976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416fce4-8e59-4495-9301-375fd66ef231 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:56.292867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:56.304967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aaeb56-2ffe-44cd-9cc1-459fbaa95c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:56.306057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaeb56-2ffe-44cd-9cc1-459fbaa95c7b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.306541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaeb56-2ffe-44cd-9cc1-459fbaa95c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.307010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aaeb56-2ffe-44cd-9cc1-459fbaa95c7b None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.307915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaeb56-2ffe-44cd-9cc1-459fbaa95c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:56.309604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aaeb56-2ffe-44cd-9cc1-459fbaa95c7b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:56.319028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 374/780] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:25:56 2022] GET /identity/v3/services => generated 772 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:56.337913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b451ae-588c-41ec-aade-e068b76a2808 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.338393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b451ae-588c-41ec-aade-e068b76a2808 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.338673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b451ae-588c-41ec-aade-e068b76a2808 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.340291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 407/781] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:56.345835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbc3da-99e0-460c-a913-816720c16818 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.346156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbc3da-99e0-460c-a913-816720c16818 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.346424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbc3da-99e0-460c-a913-816720c16818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.367739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8bcbc3da-99e0-460c-a913-816720c16818 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:56.369332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8bcbc3da-99e0-460c-a913-816720c16818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:56.457644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 375/782] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:56.497577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b451ae-588c-41ec-aade-e068b76a2808 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:56.570551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:56.642266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b451ae-588c-41ec-aade-e068b76a2808 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:56.678415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83236c23-76c9-42bf-af2d-c361c7c3caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:56.679263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83236c23-76c9-42bf-af2d-c361c7c3caee None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.679548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83236c23-76c9-42bf-af2d-c361c7c3caee None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.679819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83236c23-76c9-42bf-af2d-c361c7c3caee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.684069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f80631-72ce-4de5-a2a4-1f73271cbe9c None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.684355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f80631-72ce-4de5-a2a4-1f73271cbe9c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.684630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f80631-72ce-4de5-a2a4-1f73271cbe9c None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.686551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 376/783] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:56.690718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83236c23-76c9-42bf-af2d-c361c7c3caee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:56.691653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33423b-2ba5-4516-9324-3e0940d750b1 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.691936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33423b-2ba5-4516-9324-3e0940d750b1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.692207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33423b-2ba5-4516-9324-3e0940d750b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-83236c23-76c9-42bf-af2d-c361c7c3caee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:56.698666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:56.699566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:56.700398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 408/784] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:56.707028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83236c23-76c9-42bf-af2d-c361c7c3caee None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:56.717744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8f33423b-2ba5-4516-9324-3e0940d750b1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:56.719060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8f33423b-2ba5-4516-9324-3e0940d750b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:56.788580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 377/785] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:56.818501 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33423b-2ba5-4516-9324-3e0940d750b1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:56.863097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83236c23-76c9-42bf-af2d-c361c7c3caee None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:56.881975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:56.886345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:56.926997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33423b-2ba5-4516-9324-3e0940d750b1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:56.947306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:56.947994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.948281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.948563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.949334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:56.949645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:56.951061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:56.962880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0d00b-902a-4a90-a385-d9110a6eed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:56.963694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d00b-902a-4a90-a385-d9110a6eed61 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:56.963974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d00b-902a-4a90-a385-d9110a6eed61 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:56.964246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d00b-902a-4a90-a385-d9110a6eed61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:56.970725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 409/786] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:56.979000 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:56.980170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0d00b-902a-4a90-a385-d9110a6eed61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-edf0d00b-902a-4a90-a385-d9110a6eed61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:56.988452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:56.989486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:56.990356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 378/787] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:25:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:56.997395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0d00b-902a-4a90-a385-d9110a6eed61 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:57.118502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0d00b-902a-4a90-a385-d9110a6eed61 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:57.143647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:57.180133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fda8c-9c1d-41b0-b623-ee78b4de8289 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:57.182678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:57.183350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:57.183626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:57.183892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:57.184651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:57.184951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:57.186338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:57.204493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 379/788] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:25:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:57.210828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:57.255354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:57.256528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:57.257002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:57.257492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:57.281595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:57.283504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:57.324057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07615f-c27d-4763-b680-bf9fd4b27e37 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:57.325407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:57.326300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:57.327168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:57.327168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:57.327168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:57.327168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:57.329389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 410/789] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:57.343643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:57.364117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:57.364921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:57.365205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:57.365469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:57.377293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:57.378484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:57.396388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:57.397471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:57.398333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:57.399793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:57.399793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:57.399793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:57.399793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:57.402397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 380/790] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:57.409967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:57.447679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:57.490916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b2b54-ef17-4c6b-9a9e-26f22ed6f323 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:57.513007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c6c502-34c5-43be-8f63-7ae7358eb305 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:57.549484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:57.550586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:57.551010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:57.551462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:57.552592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:57.553066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:57.555070 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:57.567916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 381/791] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:57.573788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:57.590830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:57.591490 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:57.591858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:57.592238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:57.593046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:57.593413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:57.594886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:57.628548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 411/792] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:25:57.646946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:57.674394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:57.688960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06599-7d96-4867-a005-5c4e61e344f7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:57.726991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:57.728327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:57.728820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:57.729360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:57.738207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:57.740381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:57.757722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:57.758854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:25:57.759803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:57.762536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 382/793] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:25:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:25:57.768575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:57.877852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95b964-0511-40be-b0c7-9d55aab7194d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:57.904653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:57.934638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:57.935735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:57.936887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:57.937839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:57.938995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:57.940908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468cdb2-4a15-40ba-8764-1a492856fd35 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:57.941379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:57.944457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:57.976687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 383/794] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jul 1 19:25:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:57.983528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:57.998258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:58.019133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.020162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.020582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.022249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.043032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.044472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:25:58.082248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:58.083300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:58.084235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 412/795] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:58.090919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.112838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb12d-54f0-4f68-94f5-7d6a54406f71 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.149511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe318f1-39da-420c-9767-ad17a6ec71ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.150691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe318f1-39da-420c-9767-ad17a6ec71ba None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.151134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe318f1-39da-420c-9767-ad17a6ec71ba None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.151542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe318f1-39da-420c-9767-ad17a6ec71ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.162719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe318f1-39da-420c-9767-ad17a6ec71ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.164462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe318f1-39da-420c-9767-ad17a6ec71ba None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-cbe318f1-39da-420c-9767-ad17a6ec71ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:58.184246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:58.185356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:58.186476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:58.186476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:58.186476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:58.186476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:58.188418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 384/796] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:58.193977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621b8e-9315-4c26-ac99-05862d52199c None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.194576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621b8e-9315-4c26-ac99-05862d52199c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.195649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87621b8e-9315-4c26-ac99-05862d52199c None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.197213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 385/797] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:58.198215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87621b8e-9315-4c26-ac99-05862d52199c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.211351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c428f61-bd94-451d-a182-0b8550756648 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.253320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d590c3b-860f-4e14-8da9-b5d266bba0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.254599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590c3b-860f-4e14-8da9-b5d266bba0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.254992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590c3b-860f-4e14-8da9-b5d266bba0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.255634 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d590c3b-860f-4e14-8da9-b5d266bba0c3 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.256942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d590c3b-860f-4e14-8da9-b5d266bba0c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:58.257346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d590c3b-860f-4e14-8da9-b5d266bba0c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.258946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d590c3b-860f-4e14-8da9-b5d266bba0c3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:58.264012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:58.272168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:58.283358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 413/798] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:58.284659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e719-ab94-4a55-9409-08b5c4c01816 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.284941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e719-ab94-4a55-9409-08b5c4c01816 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.285211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e719-ab94-4a55-9409-08b5c4c01816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.307387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-3ed7e719-ab94-4a55-9409-08b5c4c01816 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:58.307603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3ed7e719-ab94-4a55-9409-08b5c4c01816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:58.317765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87621b8e-9315-4c26-ac99-05862d52199c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.354009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.355488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.355961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.356423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.357329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:58.357822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.359529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:58.378942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 386/799] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:58.380101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.398024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 414/800] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:58.398937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7e719-ab94-4a55-9409-08b5c4c01816 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.490170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca83c1-7ef4-4127-b3a5-7b748e6a7d09 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.506280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:58.512373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7e719-ab94-4a55-9409-08b5c4c01816 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.526657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198ff9a-500f-4117-bd02-b9222ca56f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.527465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198ff9a-500f-4117-bd02-b9222ca56f43 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.527750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198ff9a-500f-4117-bd02-b9222ca56f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.528031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198ff9a-500f-4117-bd02-b9222ca56f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.539032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198ff9a-500f-4117-bd02-b9222ca56f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.540012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:58.540570 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198ff9a-500f-4117-bd02-b9222ca56f43 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:58.548669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.549836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.550148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.550426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.557757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.559227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-e198ff9a-500f-4117-bd02-b9222ca56f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:58.559599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:58.560597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:58.561651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:58.561651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:58.561651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:58.561651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:58.563200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 387/801] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:58.564541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409c58-d626-4335-9f51-bffec0adbeda None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.564963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409c58-d626-4335-9f51-bffec0adbeda None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.565366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69409c58-d626-4335-9f51-bffec0adbeda None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.566760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 388/802] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:58.567563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69409c58-d626-4335-9f51-bffec0adbeda None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:58.579146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:58.580231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 415/803] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:58.581148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.683994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69409c58-d626-4335-9f51-bffec0adbeda None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.690226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150dd2b-b672-49d7-a4cc-6690ab207c7c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.717849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec788e-4b08-4b17-9b71-de12e887599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.718670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec788e-4b08-4b17-9b71-de12e887599a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.718956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec788e-4b08-4b17-9b71-de12e887599a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.719225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec788e-4b08-4b17-9b71-de12e887599a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.724948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.725609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.725890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.726197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.726917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:58.727220 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.728621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:58.729970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec788e-4b08-4b17-9b71-de12e887599a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ebec788e-4b08-4b17-9b71-de12e887599a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:25:58.737535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:58.738600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:58.739436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 389/804] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:58.740119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a657-e8a8-4941-acd2-5ca4a2a3e123 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.740688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a657-e8a8-4941-acd2-5ca4a2a3e123 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.740688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753a657-e8a8-4941-acd2-5ca4a2a3e123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.740852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 416/805] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:58.741596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.763096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-e753a657-e8a8-4941-acd2-5ca4a2a3e123 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:58.764254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e753a657-e8a8-4941-acd2-5ca4a2a3e123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:58.787434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:58.794271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:58.832938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 390/806] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:58.834324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada805df-0500-40e5-90e9-276d766a4b4c None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.834536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada805df-0500-40e5-90e9-276d766a4b4c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.834815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada805df-0500-40e5-90e9-276d766a4b4c None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.838120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 391/807] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:25:58.838120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada805df-0500-40e5-90e9-276d766a4b4c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.847188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d46f-9c23-4365-bebd-16c45fcc9333 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.881753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.882541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.882862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.883118 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.883916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:58.884236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.885662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:58.897249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 417/808] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:58.898050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:58.954850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada805df-0500-40e5-90e9-276d766a4b4c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.988104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbb60a-fb9d-405f-9c96-cc90e32d5d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:58.988893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbb60a-fb9d-405f-9c96-cc90e32d5d0f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:58.989167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbb60a-fb9d-405f-9c96-cc90e32d5d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:58.989434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbb60a-fb9d-405f-9c96-cc90e32d5d0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:58.996203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbb60a-fb9d-405f-9c96-cc90e32d5d0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:58.996326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397f435-548a-477a-a17c-eff1e741c9e9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:58.997574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbb60a-fb9d-405f-9c96-cc90e32d5d0f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.004945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-cffbb60a-fb9d-405f-9c96-cc90e32d5d0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:25:59.011694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:59.012572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:59.013456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 392/809] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:59.014322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1a60-fa77-4c6e-8df4-4734c99d119b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.014628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1a60-fa77-4c6e-8df4-4734c99d119b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.014882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd1a60-fa77-4c6e-8df4-4734c99d119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.032613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-18dd1a60-fa77-4c6e-8df4-4734c99d119b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:25:59.033784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-18dd1a60-fa77-4c6e-8df4-4734c99d119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:25:59.035689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.036376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.036673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.036943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.037694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:59.037988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.039361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.047674 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 418/810] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:59.048477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.054414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:59.110307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 393/811] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:25:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:25:59.111217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd1a60-fa77-4c6e-8df4-4734c99d119b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.148652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70db2e-9389-4b7d-a7e3-09bed23352d2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.181340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.182149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.182432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.182708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] PATH_INFO: `/v3/services/network` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.183359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.184704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:59.196577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:59.197535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:59.198406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 419/812] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:59.199186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.216909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd1a60-fa77-4c6e-8df4-4734c99d119b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.232255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:59.251026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff6d0-c59b-4593-9f7d-f1937c91f84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.251856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff6d0-c59b-4593-9f7d-f1937c91f84d None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.252130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff6d0-c59b-4593-9f7d-f1937c91f84d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.252403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff6d0-c59b-4593-9f7d-f1937c91f84d None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/bd7b6bcd191f45d39f6c5e5a6bf7646a/roles/30dcb64cd7824d3ca9b1918b76d8e443` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.266915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff6d0-c59b-4593-9f7d-f1937c91f84d None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=bd7b6bcd191f45d39f6c5e5a6bf7646a, role_id=30dcb64cd7824d3ca9b1918b76d8e443)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.268366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff6d0-c59b-4593-9f7d-f1937c91f84d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.276680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:59.282190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 394/813] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:59 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/bd7b6bcd191f45d39f6c5e5a6bf7646a/roles/30dcb64cd7824d3ca9b1918b76d8e443 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:59.283165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff6d0-c59b-4593-9f7d-f1937c91f84d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.314639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d22ac4-3e33-4767-a409-c6b6b30de323 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.354543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.355217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.355494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.355766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.356596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:59.356901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.358614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.374198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 420/814] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:59.374851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.398575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff6d0-c59b-4593-9f7d-f1937c91f84d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.437704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.438541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.438824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.439100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.452258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.453712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:25:59.472247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:59.473182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:59.474092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:25:59.474092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:25:59.474092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:25:59.474092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:25:59.474092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 395/815] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:59.474384 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.494285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:59.502861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b015b-a90e-414c-babd-616d49dcdcd7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.526125 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:59.543263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.544375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.544871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.545364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.546576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.548284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:25:59.562321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:25:59.563479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:25:59.564317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 421/816] 10.222.0.61 () {56 vars in 1129 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:25:59.565739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.587450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c55715-50e6-4796-8763-e14de0c1273c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.630156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.631287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.631581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.631992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.632705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] RBAC: Adding query filter params (name=network) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:59.633007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.634462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.639388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 396/817] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:59.644660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.670628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100b095-a66b-4d5f-98fb-b8031691f0ef None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.709182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6d3d0-f38b-49c9-bc7c-4f08cb5bf303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.710108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6d3d0-f38b-49c9-bc7c-4f08cb5bf303 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.710716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6d3d0-f38b-49c9-bc7c-4f08cb5bf303 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.710974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6d3d0-f38b-49c9-bc7c-4f08cb5bf303 None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/6de49ef308324229b81a8fa6f3f84287/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.713063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6d3d0-f38b-49c9-bc7c-4f08cb5bf303 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=6de49ef308324229b81a8fa6f3f84287, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.714558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6d3d0-f38b-49c9-bc7c-4f08cb5bf303 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.737983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 422/818] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:25:59 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/6de49ef308324229b81a8fa6f3f84287/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:25:59.737983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6d3d0-f38b-49c9-bc7c-4f08cb5bf303 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.758063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:59.771724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d18981-e29c-4960-9dbe-907e8f46e35f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.789009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:25:59.815426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.816154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.816436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.816713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.817836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:59.818158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.820443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.834978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 397/819] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:59.836312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.857819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6d3d0-f38b-49c9-bc7c-4f08cb5bf303 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:25:59.899240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:25:59.899933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:25:59.900218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:25:59.900506 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:25:59.901224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:25:59.902160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:25:59.903837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:25:59.911250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 423/820] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:25:59.912211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:25:59.968497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31157c-4cc0-4177-8ca2-1815fd679482 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:00.005394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:00.006508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:00.007186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:00.007620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:00.007990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:00.008890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:00.009170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:00.010903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:00.022037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 398/821] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:00.023168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:00.035430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01b66f-6402-4020-9160-3891883ca258 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:00.073811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:00.074713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:00.075103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:00.075478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:00.076892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:00.084789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:00.086906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:00.101739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:00.102821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:26:00.103751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:00.107964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 424/822] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:25:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:00.108859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:00.156276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243d4ac-4c27-4670-b88e-58c54c401ce2 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:00.203416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:00.204438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:00.205436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:00.205913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:00.207050 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:00.207790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:00.210077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:00.222151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd147f4-1391-4952-b365-33398ec0146a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:00.222551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 399/823] 10.222.0.61 () {56 vars in 1124 bytes} [Fri Jul 1 19:26:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:00.224406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:00.257596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71719ce2-f08d-4d19-8377-8700634a98a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:00.258847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719ce2-f08d-4d19-8377-8700634a98a2 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:00.259339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719ce2-f08d-4d19-8377-8700634a98a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:00.259785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719ce2-f08d-4d19-8377-8700634a98a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:00.260984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71719ce2-f08d-4d19-8377-8700634a98a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:00.262843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71719ce2-f08d-4d19-8377-8700634a98a2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:00.283586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:00.298096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 425/824] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:26:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:00.299357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71719ce2-f08d-4d19-8377-8700634a98a2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:00.407901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d181a-4a07-4e2d-9ff8-43b9746ea95b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:00.413513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:00.492284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:00.493920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:00.494516 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:00.495969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:00.496998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:00.498190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:00.500502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:00.507595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71719ce2-f08d-4d19-8377-8700634a98a2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:00.519166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 400/825] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:26:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:00.524808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:00.545656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a03a-a7cc-42ae-94d0-5f88851570e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:00.546696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a03a-a7cc-42ae-94d0-5f88851570e6 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:00.547194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a03a-a7cc-42ae-94d0-5f88851570e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:00.547664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663a03a-a7cc-42ae-94d0-5f88851570e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:00.548602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663a03a-a7cc-42ae-94d0-5f88851570e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:00.550194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663a03a-a7cc-42ae-94d0-5f88851570e6 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:00.589517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 426/826] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:26:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:00.652099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437f6fc-b204-4c04-a2be-a14c05beca3c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:00.700624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c383-804f-42e1-ae35-30741bf6b9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:00.701656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c383-804f-42e1-ae35-30741bf6b9aa None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:00.702199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c383-804f-42e1-ae35-30741bf6b9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:00.702756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c383-804f-42e1-ae35-30741bf6b9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:00.728465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:00.781368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c383-804f-42e1-ae35-30741bf6b9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:00.783189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c383-804f-42e1-ae35-30741bf6b9aa None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:00.887853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 401/827] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 19:26:00.893064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a03a-a7cc-42ae-94d0-5f88851570e6 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:00.950726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:01.000172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663a03a-a7cc-42ae-94d0-5f88851570e6 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:01.034196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:01.034902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.035181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.035458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.046922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:01.048370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:01.065991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:01.066867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:01.067894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:01.067894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:01.067894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:01.067894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:01.067894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 427/828] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:01.072980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c383-804f-42e1-ae35-30741bf6b9aa None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:01.126987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:01.175638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c383-804f-42e1-ae35-30741bf6b9aa None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:01.210098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e42e18-3dc5-4901-a13b-03cdfe7c17e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:01.211411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42e18-3dc5-4901-a13b-03cdfe7c17e1 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.212019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42e18-3dc5-4901-a13b-03cdfe7c17e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.212504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42e18-3dc5-4901-a13b-03cdfe7c17e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.213415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e42e18-3dc5-4901-a13b-03cdfe7c17e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:01.213928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e42e18-3dc5-4901-a13b-03cdfe7c17e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:01.215522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e42e18-3dc5-4901-a13b-03cdfe7c17e1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:01.227851 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 402/829] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:01.236248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:01.333540 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614fed7-6c0c-40b8-b52c-9df8def518ba None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:01.341295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:01.371390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:01.372190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.372475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.372754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.379759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:01.381339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:01.385324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796686-6835-4982-84a1-8cc8869c26f8 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.385850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796686-6835-4982-84a1-8cc8869c26f8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.386355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53796686-6835-4982-84a1-8cc8869c26f8 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.391865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 403/830] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:01.393749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b538-0bac-46cb-871b-cc6b65dfccd9 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.394311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b538-0bac-46cb-871b-cc6b65dfccd9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.394786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530b538-0bac-46cb-871b-cc6b65dfccd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:01.400745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:01.401728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:01.402672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:01.402672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:01.402672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:01.402672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:01.402672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:01.402672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:01.402672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:01.402672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:01.403579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 428/831] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:01.409270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:01.416335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7530b538-0bac-46cb-871b-cc6b65dfccd9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:01.417620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7530b538-0bac-46cb-871b-cc6b65dfccd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:01.493143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 404/832] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:01.516458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530b538-0bac-46cb-871b-cc6b65dfccd9 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:01.529477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13607e90-55b0-42b0-beed-163e22edfeab None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:01.564078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:01.566659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:01.567906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.568368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.568787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.569844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:01.570250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:01.571929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:01.586471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 429/833] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:01.595309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:01.626367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:01.647595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530b538-0bac-46cb-871b-cc6b65dfccd9 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:01.682954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eb229-ea57-45e3-9344-1a0e7af6474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:01.684005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eb229-ea57-45e3-9344-1a0e7af6474f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.684429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eb229-ea57-45e3-9344-1a0e7af6474f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.684874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eb229-ea57-45e3-9344-1a0e7af6474f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.696670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5eb229-ea57-45e3-9344-1a0e7af6474f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-4f5eb229-ea57-45e3-9344-1a0e7af6474f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:01.704841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:01.705981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:26:01.707026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:01.707705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeb3c8-78f9-422c-b328-5c655db7c041 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:01.714479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 405/834] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:26:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:01.716143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eb229-ea57-45e3-9344-1a0e7af6474f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:01.755044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:01.756195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.756702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.757579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.758927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=d78ccd9541dc48cfbdfc116dcec91a2f) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:01.759599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:01.761813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:01.770356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 430/835] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:01 2022] GET /identity/v3/role_assignments?user.id=d78ccd9541dc48cfbdfc116dcec91a2f&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:01.854323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eb229-ea57-45e3-9344-1a0e7af6474f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:01.856036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:01.897768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e8753-3259-40f4-ac4b-0541b81378f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:01.898489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8753-3259-40f4-ac4b-0541b81378f0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:01.898767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8753-3259-40f4-ac4b-0541b81378f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:01.899153 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e8753-3259-40f4-ac4b-0541b81378f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:01.900280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8753-3259-40f4-ac4b-0541b81378f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:01.900585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8753-3259-40f4-ac4b-0541b81378f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:01.902041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e8753-3259-40f4-ac4b-0541b81378f0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:01.912540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 406/836] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:26:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:01.919089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.013086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad663ea7-4a9f-44d1-9b42-18de702eac7c None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.013407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad663ea7-4a9f-44d1-9b42-18de702eac7c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.013655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad663ea7-4a9f-44d1-9b42-18de702eac7c None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.015293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 407/837] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:02.020942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:02.021740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741495-cfde-4fbb-a0aa-95e3c997af01 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.022278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741495-cfde-4fbb-a0aa-95e3c997af01 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.022741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741495-cfde-4fbb-a0aa-95e3c997af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.033874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9261d0e-def3-4954-8b0b-74c05aa4c4c5 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.043069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d9741495-cfde-4fbb-a0aa-95e3c997af01 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:02.044717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d9741495-cfde-4fbb-a0aa-95e3c997af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:02.085452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.086786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.087535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.087886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.100895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:02.103205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:02.126526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:02.127695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:02.129260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:02.129260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:02.129260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:02.129260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:02.129731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 431/838] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:02.135465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.142119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 408/839] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:02.167157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741495-cfde-4fbb-a0aa-95e3c997af01 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.283977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3743f4-c135-4dfe-a51d-1023adfe52a7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.289401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:02.301508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741495-cfde-4fbb-a0aa-95e3c997af01 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.320323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.320976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.321312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.321598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.322361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:02.322664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:02.324095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:02.341999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 432/840] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:02.344499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.347539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108211-5d76-4eb1-93bb-b76f4b97bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.347808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:02.349117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108211-5d76-4eb1-93bb-b76f4b97bd54 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.349399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108211-5d76-4eb1-93bb-b76f4b97bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.349677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b108211-5d76-4eb1-93bb-b76f4b97bd54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.367627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b108211-5d76-4eb1-93bb-b76f4b97bd54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-3b108211-5d76-4eb1-93bb-b76f4b97bd54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:02.376049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:02.377076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:02.377928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:02.382617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 409/841] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:02.383486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108211-5d76-4eb1-93bb-b76f4b97bd54 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.458978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8841414-9294-4c2e-80c2-2cab2f4c8fa5 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.498039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.499153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.499658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.500095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.500572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b108211-5d76-4eb1-93bb-b76f4b97bd54 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.509234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:02.511006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:02.528201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:02.529414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:26:02.530487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:02.532777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 433/842] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:02.538743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.540945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.541730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.542134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.542502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.543478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:02.543901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:02.545460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:02.555175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 410/843] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:02.560670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.582287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:02.620195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:02.669185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a52d4-5d5e-4658-afcc-d5f4829b2b31 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.670779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6183f7ff-225a-4d6a-ac2b-ae63bcdfa89f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.704604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.705655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.706112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.706526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.713329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.714135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.714510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.714878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.716246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:02.716663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:02.718733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:02.723365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:02.724804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:02.746043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 434/844] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:02.747726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:02.749218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:02.750091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:02.751149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:02.751149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:02.751149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:02.751149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:02.751149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 411/845] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:02.758985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.846322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:02.855954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552c7e6-a078-4d50-969f-9ab395bf464c None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.865208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271cdd1-b9b4-4f66-a6eb-6d83f8fd7726 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:02.876442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:02.891673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d9220-88fe-4a48-a414-3c8f1d0ce44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.892317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d9220-88fe-4a48-a414-3c8f1d0ce44f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.892596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d9220-88fe-4a48-a414-3c8f1d0ce44f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.892891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d9220-88fe-4a48-a414-3c8f1d0ce44f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.900626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad34ae-6721-46a0-8331-c143887169a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:02.901648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad34ae-6721-46a0-8331-c143887169a5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.902135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad34ae-6721-46a0-8331-c143887169a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.902601 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad34ae-6721-46a0-8331-c143887169a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.903629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad34ae-6721-46a0-8331-c143887169a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:02.904041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad34ae-6721-46a0-8331-c143887169a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:02.905598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad34ae-6721-46a0-8331-c143887169a5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:02.922320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 412/846] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:02.923474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce746e23-3c79-4466-9923-68fcb87e8a08 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:02.924069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce746e23-3c79-4466-9923-68fcb87e8a08 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:02.924180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce746e23-3c79-4466-9923-68fcb87e8a08 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:02.925379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 413/847] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:02.926510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce746e23-3c79-4466-9923-68fcb87e8a08 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:02.970702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d9220-88fe-4a48-a414-3c8f1d0ce44f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:02.972208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d9220-88fe-4a48-a414-3c8f1d0ce44f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.046614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce746e23-3c79-4466-9923-68fcb87e8a08 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.076705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:03.087346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.088398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.088683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.088962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.094983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 435/848] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 19:26:03.096571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.097172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea93cd3-409f-4f9e-bc60-f352591c5a57 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.097625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea93cd3-409f-4f9e-bc60-f352591c5a57 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.098059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.098358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea93cd3-409f-4f9e-bc60-f352591c5a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:03.114463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:03.115427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:03.116352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 414/849] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:26:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:03.116929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.118533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-cea93cd3-409f-4f9e-bc60-f352591c5a57 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:03.120005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cea93cd3-409f-4f9e-bc60-f352591c5a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:03.138704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:03.206985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 436/850] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:03.207762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea93cd3-409f-4f9e-bc60-f352591c5a57 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.226820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936708ba-90cd-4841-938c-85c2f3305dd6 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.262538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.263325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.263603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.263868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.274530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.275992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:03.293473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:03.294442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:03.295423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:03.295423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:03.295423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:03.295423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:03.295423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 415/851] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:03.295695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.318816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea93cd3-409f-4f9e-bc60-f352591c5a57 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.339472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:03.354823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.355492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.355774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.356041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.356879 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:03.357189 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.358649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.381468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 437/852] 10.222.0.61 () {56 vars in 1135 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:03.381468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.392559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:03.404414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd18502-cab0-4c74-ba43-8b5d4cdf72c8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.439631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.440430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.440712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.440985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.441635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.443052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:03.455481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:03.456489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:03.457369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 416/853] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:03.462573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.489270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550064-6a2c-48cb-a27d-ecf4609ca844 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.524691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.525459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.525806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.526239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.526891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:03.527391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.528545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.544603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 438/854] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:03.544603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.573826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcb91f-0b3b-4114-864b-bd6553a05824 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.578312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:03.612237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:03.615383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1efdbb-1be4-461d-accb-2e0bc753109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.616665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1efdbb-1be4-461d-accb-2e0bc753109e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.616665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1efdbb-1be4-461d-accb-2e0bc753109e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.616665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1efdbb-1be4-461d-accb-2e0bc753109e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.647520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290f6bb-df9e-4800-9add-55daaf7e35de None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.681728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.682418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.682701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.682976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.683680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:03.683989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.685356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.685558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1efdbb-1be4-461d-accb-2e0bc753109e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.687031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1efdbb-1be4-461d-accb-2e0bc753109e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.690507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 439/855] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:03.691175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.799780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016f2d-6f62-4492-bdfc-9dc606405dd8 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.806217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 417/856] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:03.806217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1efdbb-1be4-461d-accb-2e0bc753109e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.807892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:03.836303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:03.842495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.843307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.843594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.843876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.851371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.852939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:03.868418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:03.869309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 440/857] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:03.870619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.912382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1efdbb-1be4-461d-accb-2e0bc753109e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:03.948515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:03.949187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:03.949465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:03.949739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:03.950489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:03.950796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:03.952165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:03.956522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 418/858] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:03.957274 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:03.974215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a59e3-75dd-4d2c-ab6e-9993ea6b331b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.013207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47aa231-5349-4e20-b9b4-477e2ba2698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.014064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aa231-5349-4e20-b9b4-477e2ba2698c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.014405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aa231-5349-4e20-b9b4-477e2ba2698c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.014680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47aa231-5349-4e20-b9b4-477e2ba2698c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.026022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47aa231-5349-4e20-b9b4-477e2ba2698c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.027503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47aa231-5349-4e20-b9b4-477e2ba2698c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-d47aa231-5349-4e20-b9b4-477e2ba2698c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:04.046292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:04.047251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:04.048141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:04.048141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:04.048141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:04.048141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:04.048141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 441/859] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:04.049674 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7301-5b43-4d7d-8ba9-06fedfb70637 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.050101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7301-5b43-4d7d-8ba9-06fedfb70637 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.050378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7301-5b43-4d7d-8ba9-06fedfb70637 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.052199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 442/860] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:04.057112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7301-5b43-4d7d-8ba9-06fedfb70637 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:04.064499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:04.093049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d365c7d-b155-418c-83d4-ec9a9fb0352e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.111077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:04.134850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7355a4f-c3fa-4183-979f-9936ce10ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.135512 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7355a4f-c3fa-4183-979f-9936ce10ba9a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.135797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7355a4f-c3fa-4183-979f-9936ce10ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.136071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7355a4f-c3fa-4183-979f-9936ce10ba9a None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.136870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7355a4f-c3fa-4183-979f-9936ce10ba9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:04.137178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7355a4f-c3fa-4183-979f-9936ce10ba9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.138706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7355a4f-c3fa-4183-979f-9936ce10ba9a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.151988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 419/861] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:04.153238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502bcb-30f1-412e-a3a3-45678db8d162 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.153526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502bcb-30f1-412e-a3a3-45678db8d162 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.153801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502bcb-30f1-412e-a3a3-45678db8d162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.174624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7301-5b43-4d7d-8ba9-06fedfb70637 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.215632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.216722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.217185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.217632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.218578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:04.219126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.220764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.239658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 443/862] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:04.240947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:04.290115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1c502bcb-30f1-412e-a3a3-45678db8d162 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:04.291316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1c502bcb-30f1-412e-a3a3-45678db8d162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:04.352098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1945a-d1d7-443c-98f7-a06b3cd259b3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.354421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:04.366068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 420/863] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:04.366068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c502bcb-30f1-412e-a3a3-45678db8d162 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:04.391990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.392646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.392930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.393202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.394404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=bd7b6bcd191f45d39f6c5e5a6bf7646a) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:04.394541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.396010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.409987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 444/864] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:04 2022] GET /identity/v3/role_assignments?user.id=bd7b6bcd191f45d39f6c5e5a6bf7646a&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:04.409987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:04.450368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:04.498474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c502bcb-30f1-412e-a3a3-45678db8d162 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.522551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a31512-4100-45b2-8b83-7bc38a368d9e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.538586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.539399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.539677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.540003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.550120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.552502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.565097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.565994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.566278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.566555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.567228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.568667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:04.573259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:04.574735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:04.575638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:04.575638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:04.575638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:04.575638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:04.575638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:04.575638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:04.575638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:04.575638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:04.578353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 421/865] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:04.590060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:04.590254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:04.591113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:04.591942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 445/866] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jul 1 19:26:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:04.593784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:04.635133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:04.719087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1d6b4-1cdf-4fcd-b93e-94617bbaf910 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.726686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23562b-f0cf-479a-a5e4-9c11e559b02d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.744457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:04.763490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.764079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.764202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.764420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.764697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.765327 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.765483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:04.765794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.766057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.766467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.767258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.767472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:04.767909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.770149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.776059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 446/867] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:04.781685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:04.781842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 422/868] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:04.787558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:04.886637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:04.893388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eefa4-8a5d-4d0a-98bb-5ef75e1f0084 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.898324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9358e-c249-40ef-a00d-e81fe16cd05b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:04.928429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b17246-6731-482b-a0cb-eaad87e4672f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.929233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17246-6731-482b-a0cb-eaad87e4672f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.929612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17246-6731-482b-a0cb-eaad87e4672f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.930038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b17246-6731-482b-a0cb-eaad87e4672f None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.930916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b17246-6731-482b-a0cb-eaad87e4672f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:04.931313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b17246-6731-482b-a0cb-eaad87e4672f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.932778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b17246-6731-482b-a0cb-eaad87e4672f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.935340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99341906-cc43-47c7-aab0-f3c6f6357405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:04.935993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99341906-cc43-47c7-aab0-f3c6f6357405 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:04.936275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99341906-cc43-47c7-aab0-f3c6f6357405 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:04.936572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99341906-cc43-47c7-aab0-f3c6f6357405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:04.937461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99341906-cc43-47c7-aab0-f3c6f6357405 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=6de49ef308324229b81a8fa6f3f84287) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:04.937777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99341906-cc43-47c7-aab0-f3c6f6357405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:04.938294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 447/869] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:04.939375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99341906-cc43-47c7-aab0-f3c6f6357405 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:04.948630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 423/870] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:04 2022] GET /identity/v3/role_assignments?user.id=6de49ef308324229b81a8fa6f3f84287&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:06.016780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a926c4-a30d-4e8e-9a58-4bcfcadd962a None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:06.017309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a926c4-a30d-4e8e-9a58-4bcfcadd962a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:06.017309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a926c4-a30d-4e8e-9a58-4bcfcadd962a None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:06.019088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 448/871] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:06.024242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3312-a188-4de6-969e-7dfce8928430 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:06.024688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3312-a188-4de6-969e-7dfce8928430 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:06.024924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f3312-a188-4de6-969e-7dfce8928430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:06.041674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-e95f3312-a188-4de6-969e-7dfce8928430 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:06.042906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e95f3312-a188-4de6-969e-7dfce8928430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:06.079598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:06.118288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 424/872] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:06.141423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a926c4-a30d-4e8e-9a58-4bcfcadd962a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:06.243164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a926c4-a30d-4e8e-9a58-4bcfcadd962a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:06.276990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321f2c-0606-4a90-9b1c-2be01540a204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:06.277923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321f2c-0606-4a90-9b1c-2be01540a204 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:06.278411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321f2c-0606-4a90-9b1c-2be01540a204 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:06.278864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321f2c-0606-4a90-9b1c-2be01540a204 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:06.279781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321f2c-0606-4a90-9b1c-2be01540a204 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:06.281404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321f2c-0606-4a90-9b1c-2be01540a204 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:06.298966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 449/873] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:26:06 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:06.658722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaa35d-f73d-48f9-8e34-ed41546b42d9 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:06.659131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaa35d-f73d-48f9-8e34-ed41546b42d9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:06.659307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaa35d-f73d-48f9-8e34-ed41546b42d9 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:06.660890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 425/874] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:06.666559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655bb95-0853-4ddb-bec9-27f593312ade None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:06.666852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655bb95-0853-4ddb-bec9-27f593312ade None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:06.667130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655bb95-0853-4ddb-bec9-27f593312ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:06.684112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c655bb95-0853-4ddb-bec9-27f593312ade None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:06.685295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c655bb95-0853-4ddb-bec9-27f593312ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:06.699707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:06.766059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 450/875] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:06 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:06.785438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaa35d-f73d-48f9-8e34-ed41546b42d9 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:06.890002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaa35d-f73d-48f9-8e34-ed41546b42d9 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:06.925926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee67d3-4d1f-4117-80ed-51699d755703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:06.926691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee67d3-4d1f-4117-80ed-51699d755703 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:06.926968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee67d3-4d1f-4117-80ed-51699d755703 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:06.927238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee67d3-4d1f-4117-80ed-51699d755703 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:06.937821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee67d3-4d1f-4117-80ed-51699d755703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-1eee67d3-4d1f-4117-80ed-51699d755703 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:06.946141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:06.947052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:06.947894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:06.952313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 426/876] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jul 1 19:26:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:06.953694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655bb95-0853-4ddb-bec9-27f593312ade None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.057531 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9cd0-450f-4252-8773-730f38925bae None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.058093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9cd0-450f-4252-8773-730f38925bae None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.058397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc9cd0-450f-4252-8773-730f38925bae None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.060293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 427/877] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:07.063839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655bb95-0853-4ddb-bec9-27f593312ade None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.066169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a4e2-7db7-41cc-8934-7cd320e89b93 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.066559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a4e2-7db7-41cc-8934-7cd320e89b93 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.066951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a4e2-7db7-41cc-8934-7cd320e89b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.083732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8689a4e2-7db7-41cc-8934-7cd320e89b93 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:07.084985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8689a4e2-7db7-41cc-8934-7cd320e89b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:07.099461 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea074c-60a3-40eb-bb56-26a156221149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.100409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea074c-60a3-40eb-bb56-26a156221149 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.100694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea074c-60a3-40eb-bb56-26a156221149 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.100974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea074c-60a3-40eb-bb56-26a156221149 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.101756 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea074c-60a3-40eb-bb56-26a156221149 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:07.102064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea074c-60a3-40eb-bb56-26a156221149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.103469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ea074c-60a3-40eb-bb56-26a156221149 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.111408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:07.112562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 451/878] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jul 1 19:26:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:07.113687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a772-0e10-4c3c-9027-3d1727bde004 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.117469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a772-0e10-4c3c-9027-3d1727bde004 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.117469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a772-0e10-4c3c-9027-3d1727bde004 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.117469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 452/879] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:07.118028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a772-0e10-4c3c-9027-3d1727bde004 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.131115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:07.159373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 428/880] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:07.160858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff1f5-2aa2-47e9-a9de-2ef7bb50b041 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.161240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff1f5-2aa2-47e9-a9de-2ef7bb50b041 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.161580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fff1f5-2aa2-47e9-a9de-2ef7bb50b041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.184225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f8fff1f5-2aa2-47e9-a9de-2ef7bb50b041 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:07.185420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f8fff1f5-2aa2-47e9-a9de-2ef7bb50b041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:07.227632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a772-0e10-4c3c-9027-3d1727bde004 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.255497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 429/881] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:07 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:07.256235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fff1f5-2aa2-47e9-a9de-2ef7bb50b041 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.270143 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.271817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.272388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.272861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.287934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.290004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:07.314023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:07.314957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:07.315849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:07.315849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:07.315849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:07.315849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:07.322863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 453/882] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:07.322863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.356126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:07.366968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fff1f5-2aa2-47e9-a9de-2ef7bb50b041 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.384267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:07.403857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.405025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.405234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.405510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.406195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.407564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:07.419571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:07.420568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:07.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 430/883] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:07.422237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.432400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c564f-0c4f-476f-b688-95abe65106de None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.470998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd00dd-7ce5-4da4-8df3-e4a621bcf19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.472070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd00dd-7ce5-4da4-8df3-e4a621bcf19a None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.472576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd00dd-7ce5-4da4-8df3-e4a621bcf19a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.473064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd00dd-7ce5-4da4-8df3-e4a621bcf19a None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.473933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd00dd-7ce5-4da4-8df3-e4a621bcf19a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.475662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd00dd-7ce5-4da4-8df3-e4a621bcf19a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.501978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 454/884] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:26:07 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:07.501978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd00dd-7ce5-4da4-8df3-e4a621bcf19a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.539478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6c7c-0f53-4158-9d8c-921ff315002d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.583756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.584518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.584867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.585525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.586358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:07.586785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.588336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.607108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 431/885] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:07.620101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.636464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:07.636916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd00dd-7ce5-4da4-8df3-e4a621bcf19a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.663312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:07.682112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.682952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.683345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.683710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.684526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:07.684923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.686592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.691904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 455/886] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:07.697988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.751092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36ba77-6742-446f-9f16-c1fcbbf7a3e5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.786525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.787450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.787734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.788007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.796988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.798538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.812751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36f79e-db64-46c4-8a87-88c4fe193d2b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:07.815830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:07.817056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:07.818335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 432/887] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:26:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:07.822710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:07.852628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.853664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.854124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.854656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.855503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:07.855989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.857544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.870102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 456/888] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:07.898704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:07.932068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03397caf-7f20-40b0-9797-107573f15448 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:07.970567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:07.971248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:07.971597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:07.971874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:07.972769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:07.973081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:07.974616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:07.996605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 433/889] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jul 1 19:26:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:08.002147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:08.062051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:08.124340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dec8ae-2894-4f21-b274-719eebb95bd1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:08.159847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c642a4d-09f7-4529-aa9b-df27e835f565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:08.160846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642a4d-09f7-4529-aa9b-df27e835f565 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:08.161347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642a4d-09f7-4529-aa9b-df27e835f565 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:08.161818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c642a4d-09f7-4529-aa9b-df27e835f565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:08.232458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642a4d-09f7-4529-aa9b-df27e835f565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:08.234321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c642a4d-09f7-4529-aa9b-df27e835f565 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:08.284460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:08.338046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 457/890] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:08 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:08.346002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:08.405243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b301a8-a1c3-4fb8-b523-27f975f024f0 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:08.405880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b301a8-a1c3-4fb8-b523-27f975f024f0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:08.406406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b301a8-a1c3-4fb8-b523-27f975f024f0 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:08.408340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 458/891] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:08.414399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c6108-bad5-416b-967c-cab579abe3bf None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:08.414955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c6108-bad5-416b-967c-cab579abe3bf None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:08.415434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c6108-bad5-416b-967c-cab579abe3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:08.433241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6c8c6108-bad5-416b-967c-cab579abe3bf None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:08.434833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6c8c6108-bad5-416b-967c-cab579abe3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:08.451586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b8cde-4ff2-42bc-a6e9-5bddd533f7e3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:08.485182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:08.491874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:08.492674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:08.493030 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:08.493377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:08.504435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:08.506190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:08.514356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 459/892] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:08.525245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:08.526432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:08.527568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:08.527568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:08.527568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:08.527568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:08.527568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 434/893] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:08.530500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c6108-bad5-416b-967c-cab579abe3bf None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:08.536725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:08.618168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:08.639502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0419b7-aeb8-4c10-bb0d-ad547376a860 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:08.644843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c6108-bad5-416b-967c-cab579abe3bf None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:08.675996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:08.676817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:08.677062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:08.677331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:08.678014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:08.679376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:08.689279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:08.690206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:08.690686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:08.691156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:08.692095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:08.692217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:08.693126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:08.693982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:08.695766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:08.697452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:08.698394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 435/894] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:08.699237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:08.714088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 460/895] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:08.719019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:08.754882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:08.814864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582acb9-a662-4ea4-81a8-381e51c0f2a8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:08.851517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c99e5-80a6-4fa4-8b76-6db7cf235cfc None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:08.857562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:08.858499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:08.859373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:08.859874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:08.861115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:08.861622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:08.863965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:08.871065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 436/896] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:08.878577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:08.889431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:08.890446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:08.890558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:08.890827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:08.898709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:08.900001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:08.901733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:08.916672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:08.917600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:08.918509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:08.918509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:08.918509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:08.918509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:08.918509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:08.918509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:08.918509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:08.918509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:08.922202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 461/897] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:08.923995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:08.999981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d805ec3-5f88-4f2a-acc0-20dd11d2e3e3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:09.012811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:09.037358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3546a-5762-4dec-8910-907a54f56478 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:09.042466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:09.043448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:09.043926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:09.044418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:09.045329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:09.045828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:09.047506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:09.053877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 437/898] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:09.064233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:09.078671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:09.079660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:09.080145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:09.080747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:09.082049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:09.082531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:09.084359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:09.105301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 462/899] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:09.106542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:09.180227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:09.189158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4aae93-48e4-48f2-8156-ab9e0421d011 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:09.225864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a9ee7-967e-46c8-9e6e-278188421fad None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:09.232835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:09.233617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:09.233900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:09.234207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:09.235058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] RBAC: Adding query filter params (interface=public, service_id=9a5871b846d74198a8be516bb8ef6b3e, region_id=RegionOne) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:09.235374 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:09.237326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:09.245992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 438/900] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jul 1 19:26:09 2022] GET /identity/v3/endpoints?service_id=9a5871b846d74198a8be516bb8ef6b3e&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:09.250088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:09.269263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53990-e82a-473a-b056-b48e24afac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:09.270180 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53990-e82a-473a-b056-b48e24afac69 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:09.270463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53990-e82a-473a-b056-b48e24afac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:09.270936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53990-e82a-473a-b056-b48e24afac69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:09.271820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53990-e82a-473a-b056-b48e24afac69 None admin] RBAC: Adding query filter params (role.id=b09f5867b4d8422dbbbbdb67ed9e8743, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=bd7b6bcd191f45d39f6c5e5a6bf7646a) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:09.272135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53990-e82a-473a-b056-b48e24afac69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:09.273671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53990-e82a-473a-b056-b48e24afac69 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:09.286375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 463/901] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:09 2022] GET /identity/v3/role_assignments?user.id=bd7b6bcd191f45d39f6c5e5a6bf7646a&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=b09f5867b4d8422dbbbbdb67ed9e8743 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:09.298102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:09.368203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f7939-f92e-470b-981e-fcce9b174496 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:09.406533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b9904-7b5a-42e5-b744-9eb5eed013f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:09.407522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9904-7b5a-42e5-b744-9eb5eed013f9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:09.408001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9904-7b5a-42e5-b744-9eb5eed013f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:09.408450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b9904-7b5a-42e5-b744-9eb5eed013f9 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:09.409312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b9904-7b5a-42e5-b744-9eb5eed013f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:09.410892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b9904-7b5a-42e5-b744-9eb5eed013f9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:09.418159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 439/902] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:26:09 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:26:09.702576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcabc1a-c91a-43da-b155-39aaa3536558 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:09.702917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcabc1a-c91a-43da-b155-39aaa3536558 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:09.703133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcabc1a-c91a-43da-b155-39aaa3536558 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:09.704774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 464/903] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:09.710378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5fb41-2813-41ea-8f90-dd211150ec41 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:09.710671 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5fb41-2813-41ea-8f90-dd211150ec41 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:09.710949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5fb41-2813-41ea-8f90-dd211150ec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:09.727922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-84e5fb41-2813-41ea-8f90-dd211150ec41 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:09.729116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-84e5fb41-2813-41ea-8f90-dd211150ec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:09.805309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 440/904] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:09.828839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcabc1a-c91a-43da-b155-39aaa3536558 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:09.933980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcabc1a-c91a-43da-b155-39aaa3536558 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:09.958205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:09.971910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95055cea-6806-4bd3-9e88-7c79515dee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:09.972961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95055cea-6806-4bd3-9e88-7c79515dee42 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:09.973279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95055cea-6806-4bd3-9e88-7c79515dee42 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:09.973555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95055cea-6806-4bd3-9e88-7c79515dee42 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:09.974235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95055cea-6806-4bd3-9e88-7c79515dee42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:09.975653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95055cea-6806-4bd3-9e88-7c79515dee42 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-95055cea-6806-4bd3-9e88-7c79515dee42 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:09.988519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:09.989498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:09.990365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 465/905] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jul 1 19:26:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:09.996054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5fb41-2813-41ea-8f90-dd211150ec41 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:10.000928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd11cc2-7e00-43e2-84e0-b09a5dcaaf83 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:10.001213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd11cc2-7e00-43e2-84e0-b09a5dcaaf83 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:10.001485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd11cc2-7e00-43e2-84e0-b09a5dcaaf83 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:10.004712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 466/906] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:10.013217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020741e5-7f9b-4dd4-9397-5a10782ac85e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:10.013499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020741e5-7f9b-4dd4-9397-5a10782ac85e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:10.013773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020741e5-7f9b-4dd4-9397-5a10782ac85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:10.034050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-020741e5-7f9b-4dd4-9397-5a10782ac85e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:10.035544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-020741e5-7f9b-4dd4-9397-5a10782ac85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:10.050392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:10.119041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5fb41-2813-41ea-8f90-dd211150ec41 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:10.125368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 467/907] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:10.143239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020741e5-7f9b-4dd4-9397-5a10782ac85e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:10.166870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:10.167856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:10.168903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:10.169540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:10.170558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:10.171292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:10.173557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:10.180521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 441/908] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:10.189979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:10.252923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020741e5-7f9b-4dd4-9397-5a10782ac85e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:10.270117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:10.281307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:10.287323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee4198-862c-473c-ad7f-b6dec9c77bc0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:10.293011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504bc9f-f4c1-4f02-8879-06d38898051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:10.293871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504bc9f-f4c1-4f02-8879-06d38898051a None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:10.294311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504bc9f-f4c1-4f02-8879-06d38898051a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:10.294791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504bc9f-f4c1-4f02-8879-06d38898051a None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:10.295792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504bc9f-f4c1-4f02-8879-06d38898051a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:10.297285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504bc9f-f4c1-4f02-8879-06d38898051a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:10.313893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 468/909] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:26:10 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:26:10.338826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:10.339614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:10.339964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:10.340330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:10.341183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:10.341562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:10.343184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:10.354148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 442/910] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:10.355864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504bc9f-f4c1-4f02-8879-06d38898051a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:10.468793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504bc9f-f4c1-4f02-8879-06d38898051a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:10.507449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f31345-75fe-4c22-8a14-9eadb630116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:10.508030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f31345-75fe-4c22-8a14-9eadb630116a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:10.508307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f31345-75fe-4c22-8a14-9eadb630116a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:10.508643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f31345-75fe-4c22-8a14-9eadb630116a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:10.509449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f31345-75fe-4c22-8a14-9eadb630116a None admin] RBAC: Adding query filter params (interface=public, service_id=c129a9b7f2414aa5b25b965560d8c882, region_id=RegionOne) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:10.509768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f31345-75fe-4c22-8a14-9eadb630116a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:10.511265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f31345-75fe-4c22-8a14-9eadb630116a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:10.517301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 469/911] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jul 1 19:26:10 2022] GET /identity/v3/endpoints?service_id=c129a9b7f2414aa5b25b965560d8c882&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:10.522770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:10.635858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cb8f-109e-4051-9e0d-c15db8d984ac None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:10.671977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeee8a8-f131-4956-ba23-6cd69b46bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:10.672643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee8a8-f131-4956-ba23-6cd69b46bf59 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:10.672925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee8a8-f131-4956-ba23-6cd69b46bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:10.673200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeee8a8-f131-4956-ba23-6cd69b46bf59 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:10.673880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeee8a8-f131-4956-ba23-6cd69b46bf59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:10.675338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeee8a8-f131-4956-ba23-6cd69b46bf59 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:10.681970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 443/912] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:26:10 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:26:11.391456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21b1f-b031-4bdb-a810-cc797847bc9d None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:11.391998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21b1f-b031-4bdb-a810-cc797847bc9d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:11.391998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d21b1f-b031-4bdb-a810-cc797847bc9d None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:11.393641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 470/913] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:11.398930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2d703-4b69-4d41-acd0-911bd7878b09 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:11.399516 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2d703-4b69-4d41-acd0-911bd7878b09 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:11.399984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2d703-4b69-4d41-acd0-911bd7878b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:11.417303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-14b2d703-4b69-4d41-acd0-911bd7878b09 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:11.418842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-14b2d703-4b69-4d41-acd0-911bd7878b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:11.439426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:11.495505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 444/914] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:11.498867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c92781-1837-4fca-89fa-ca37ac421f6c None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:11.499162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c92781-1837-4fca-89fa-ca37ac421f6c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:11.499448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c92781-1837-4fca-89fa-ca37ac421f6c None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:11.500799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 471/915] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:11.507626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217287-c47c-4f0e-aa47-32fcec09adcb None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:11.507910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217287-c47c-4f0e-aa47-32fcec09adcb None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:11.508180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217287-c47c-4f0e-aa47-32fcec09adcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:11.518314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c92781-1837-4fca-89fa-ca37ac421f6c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:11.527330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-27217287-c47c-4f0e-aa47-32fcec09adcb None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:11.528506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-27217287-c47c-4f0e-aa47-32fcec09adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:11.572748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:11.606423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 445/916] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:11.632589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27217287-c47c-4f0e-aa47-32fcec09adcb None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:11.655080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c92781-1837-4fca-89fa-ca37ac421f6c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:11.699653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b498-7f07-498c-86ea-b9e892d8e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:11.701069 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b498-7f07-498c-86ea-b9e892d8e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:11.702129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b498-7f07-498c-86ea-b9e892d8e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:11.702630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07b498-7f07-498c-86ea-b9e892d8e1f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:11.716665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:11.717085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07b498-7f07-498c-86ea-b9e892d8e1f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-5a07b498-7f07-498c-86ea-b9e892d8e1f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:11.729759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:11.730813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:11.731692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:11.734661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 472/917] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jul 1 19:26:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:11.740417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b498-7f07-498c-86ea-b9e892d8e1f0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:11.743677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27217287-c47c-4f0e-aa47-32fcec09adcb None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:11.784535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:11.785646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:11.786266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:11.786699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:11.788004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:11.790138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:11.808021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:11.809371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 19:26:11.810457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:11.817222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 446/918] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:11.818671 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:11.848361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:11.850624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07b498-7f07-498c-86ea-b9e892d8e1f0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:11.888098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:11.888935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:11.889326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:11.889695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:11.890616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:11.891020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:11.892721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:11.902281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 473/919] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jul 1 19:26:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:11.908755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:11.930329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebfedc1-baef-421a-a248-6c9b4c513700 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:11.965495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:11.966557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:11.967072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:11.967550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:11.968473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:11.968975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:11.970575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:11.975907 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 447/920] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:11.981882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:11.997840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:12.041004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e9ca3-c76f-4e50-91e4-64f8a4d347ba None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:12.089029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:12.090279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.090660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.091029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.105924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:12.108460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:12.114092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56fc8df-1932-4599-b3e9-5159072d8185 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:12.131152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:12.132167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:12.133039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:12.133039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:12.133039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:12.133039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:12.138153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 474/921] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:12.139493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:12.159637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:12.160548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:12.162343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.164266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.164266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.164266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:12.164697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:12.166548 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:12.178034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 448/922] 10.222.0.61 () {56 vars in 1114 bytes} [Fri Jul 1 19:26:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:12.179833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:12.271104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:12.277009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507794-1b04-4b74-92e1-e2f96086673e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:12.311381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cadef3-0cdf-4d1a-b705-7c09cf716989 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:12.320872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:12.322317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.322673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.323018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.323815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:12.324211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:12.326482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:12.344009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 475/923] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:12.350314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:12.360817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fdb9b-9669-454a-8aed-89a1e7d6223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:12.361528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fdb9b-9669-454a-8aed-89a1e7d6223b None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.361812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fdb9b-9669-454a-8aed-89a1e7d6223b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.362128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fdb9b-9669-454a-8aed-89a1e7d6223b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.362870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fdb9b-9669-454a-8aed-89a1e7d6223b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:12.365123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fdb9b-9669-454a-8aed-89a1e7d6223b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:12.397969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 449/924] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:26:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:26:12.447771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e40eb-9fcf-4723-b53c-14d73bce2fc4 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.447964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e40eb-9fcf-4723-b53c-14d73bce2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.448227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e40eb-9fcf-4723-b53c-14d73bce2fc4 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.449785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 450/925] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:12.455702 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912fdc6-73c1-4d59-bf6a-3eabcb3dfd76 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.455938 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:12.456812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912fdc6-73c1-4d59-bf6a-3eabcb3dfd76 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.457305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912fdc6-73c1-4d59-bf6a-3eabcb3dfd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.475811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d912fdc6-73c1-4d59-bf6a-3eabcb3dfd76 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:12.477391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d912fdc6-73c1-4d59-bf6a-3eabcb3dfd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:12.491972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460300a-f357-4b73-a206-6c8ba4b7c18b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:12.546492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:12.547378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.548143 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.548431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.559130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:12.560505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 451/926] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:12.560958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:12.580046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:12.581032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:12.581985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 476/927] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:26:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:12.585476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912fdc6-73c1-4d59-bf6a-3eabcb3dfd76 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:12.587410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:12.657912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:12.705475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c3005d-cbbe-4fc6-8d23-e234e10d63f0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:12.720144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912fdc6-73c1-4d59-bf6a-3eabcb3dfd76 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:12.736659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:12.744153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529744d-12b8-4514-a64c-82f166f5e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:12.745002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529744d-12b8-4514-a64c-82f166f5e622 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.745279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529744d-12b8-4514-a64c-82f166f5e622 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.745576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529744d-12b8-4514-a64c-82f166f5e622 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.746450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529744d-12b8-4514-a64c-82f166f5e622 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:12.746762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529744d-12b8-4514-a64c-82f166f5e622 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:12.748195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529744d-12b8-4514-a64c-82f166f5e622 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:12.763034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14283667-3403-4300-921f-7880269d6621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:12.763835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14283667-3403-4300-921f-7880269d6621 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.764113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14283667-3403-4300-921f-7880269d6621 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.764395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14283667-3403-4300-921f-7880269d6621 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.765025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14283667-3403-4300-921f-7880269d6621 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:12.766400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14283667-3403-4300-921f-7880269d6621 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:12.766903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 477/928] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jul 1 19:26:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:12.768266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48a116-72fe-4b89-a08b-0e5ea866078a None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.768437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48a116-72fe-4b89-a08b-0e5ea866078a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.768723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48a116-72fe-4b89-a08b-0e5ea866078a None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.777989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 478/929] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:12.777989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48a116-72fe-4b89-a08b-0e5ea866078a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-14283667-3403-4300-921f-7880269d6621 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:12.786034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:12.787114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:12.787941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:12.790109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 452/930] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:12.791381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30d3f-b275-430d-bf87-fe8350f28cf9 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.791716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30d3f-b275-430d-bf87-fe8350f28cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.792002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb30d3f-b275-430d-bf87-fe8350f28cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.811573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-4bb30d3f-b275-430d-bf87-fe8350f28cf9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:12.812783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4bb30d3f-b275-430d-bf87-fe8350f28cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:12.886055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 453/931] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:12.886055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb30d3f-b275-430d-bf87-fe8350f28cf9 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:12.887726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48a116-72fe-4b89-a08b-0e5ea866078a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:12.928769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:12.929593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:12.929980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:12.930215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:12.942219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:12.943673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:12.944656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:12.962984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:12.963912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:12.964802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:12.964802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:12.964802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:12.964802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:12.964802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 479/932] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:12.965103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:12.998035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb30d3f-b275-430d-bf87-fe8350f28cf9 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.013636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:13.033292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.034072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.034362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.034641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.035383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:13.035845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.038280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.047981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 454/933] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:13.047981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.085344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525aeba-9f22-4c50-bca5-92712c9d7557 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.121612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.122446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.122730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.123005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.123661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.125025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:13.137386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:13.138411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:13.139266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 480/934] 10.222.0.61 () {56 vars in 1132 bytes} [Fri Jul 1 19:26:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:13.140098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.153555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b59ad9-3d1b-4d10-9479-f14a56b4776f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.171873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:13.193036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.194000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.194846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.195748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:13.196206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.197728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.210670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 455/935] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:13.211731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.250649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b58fd1-82bb-43eb-b906-232e0a76a322 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.253698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:13.287972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.288869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.288978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.289177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.289997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:13.290265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.291677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.301355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 481/936] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:13.301355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.335782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d033-1d97-4df2-bf12-07c0f752c96e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.368788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.369442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.369722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.370024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.370724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:13.371026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.372390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.377202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 456/937] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:13.377796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.407536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5a22d-fa9e-4427-8e14-047a7537a2e7 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.426712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:13.443293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.444290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.444722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.445002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.451913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.453330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:13.467381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:13.474093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 482/938] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:13.474983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.497340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41862b-c48d-4d06-ad95-1123b18a288a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.501994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:13.539982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.540691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.540976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.541253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.542079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] RBAC: Adding query filter params (interface=public, service_id=d0fb7bd83c2244638a40c99573f0af4b, region_id=RegionOne) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:13.542392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.543774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.549424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 457/939] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jul 1 19:26:13 2022] GET /identity/v3/endpoints?service_id=d0fb7bd83c2244638a40c99573f0af4b&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:13.550307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.584706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f8cd5-8c67-4a3f-8d2f-21f003787c58 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.622402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.623168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.623509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.623849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.624638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:13.625008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.626401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.635985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 483/940] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:13.635985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.663214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8ae8-df46-40b9-bf32-86c778609df4 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.665595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:13.700685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.701347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.701626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.702155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.702706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:13.703013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.704451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.717413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 458/941] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:13.718889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.745936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:13.755617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332b3de-9e03-439f-b278-c4e2a7c2328d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.789390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b37e6d-8b06-47cf-927c-c15c63a0788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.789755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37e6d-8b06-47cf-927c-c15c63a0788b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.790075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37e6d-8b06-47cf-927c-c15c63a0788b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.790338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b37e6d-8b06-47cf-927c-c15c63a0788b None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.791046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b37e6d-8b06-47cf-927c-c15c63a0788b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.792401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b37e6d-8b06-47cf-927c-c15c63a0788b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.805977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 484/942] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:26:13 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:26:13.805977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b37e6d-8b06-47cf-927c-c15c63a0788b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:13.857587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c6f2b-495a-4b12-8943-dcd9b93830a2 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.897368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7c7cf-51c4-46c7-99aa-91b4a8555b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.898194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c7cf-51c4-46c7-99aa-91b4a8555b89 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.898547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c7cf-51c4-46c7-99aa-91b4a8555b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.898895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7c7cf-51c4-46c7-99aa-91b4a8555b89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:13.899782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7c7cf-51c4-46c7-99aa-91b4a8555b89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:13.901310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7c7cf-51c4-46c7-99aa-91b4a8555b89 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:13.930180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 459/943] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:26:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:13.948279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b37e6d-8b06-47cf-927c-c15c63a0788b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:13.997067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff76e0-2b94-4f75-8c9b-5a65456e9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:13.997971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff76e0-2b94-4f75-8c9b-5a65456e9e95 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:13.998265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff76e0-2b94-4f75-8c9b-5a65456e9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:13.998538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff76e0-2b94-4f75-8c9b-5a65456e9e95 None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/bd7b6bcd191f45d39f6c5e5a6bf7646a/roles/b09f5867b4d8422dbbbbdb67ed9e8743` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:14.000977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff76e0-2b94-4f75-8c9b-5a65456e9e95 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=bd7b6bcd191f45d39f6c5e5a6bf7646a, role_id=b09f5867b4d8422dbbbbdb67ed9e8743)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:14.002483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff76e0-2b94-4f75-8c9b-5a65456e9e95 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:14.019275 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 485/944] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:26:13 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/bd7b6bcd191f45d39f6c5e5a6bf7646a/roles/b09f5867b4d8422dbbbbdb67ed9e8743 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:26:14.495311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dcf0c-acc4-4ae5-b961-0861d12dd561 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:14.495700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dcf0c-acc4-4ae5-b961-0861d12dd561 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:14.495910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4dcf0c-acc4-4ae5-b961-0861d12dd561 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:14.497473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 460/945] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:14.502741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5cb77-7d7f-46cb-8466-d152a4cb4045 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:14.503200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5cb77-7d7f-46cb-8466-d152a4cb4045 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:14.503294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5cb77-7d7f-46cb-8466-d152a4cb4045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:14.521075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-54b5cb77-7d7f-46cb-8466-d152a4cb4045 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:14.522278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-54b5cb77-7d7f-46cb-8466-d152a4cb4045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:14.530078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:14.592932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 486/946] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:14.616587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dcf0c-acc4-4ae5-b961-0861d12dd561 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:14.643631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:14.728355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4dcf0c-acc4-4ae5-b961-0861d12dd561 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:14.763356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:14.764256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:14.764685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:14.765106 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:14.765979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:14.767573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:14.769065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING keystone.server.flask.common [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 01 19:26:14.786608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.sql.core [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 19:26:14.786608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 01 19:26:14.786608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [parameters: {'id': 'fd5f31c1956749558dd1b4589c302ac2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 01 19:26:14.786608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80244) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fd5f31c1956749558dd1b4589c302ac2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fd5f31c1956749558dd1b4589c302ac2. Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:26:14.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application result.read() Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 01 19:26:14.805259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application yield resource Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise self.value Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application session.commit() Jul 01 19:26:14.806642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self.session.flush() Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application compat.raise_( Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 19:26:14.807838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 19:26:14.808819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application result.read() Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:26:14.809604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [parameters: {'id': 'fd5f31c1956749558dd1b4589c302ac2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:14.810507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:14.811461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fd5f31c1956749558dd1b4589c302ac2. Jul 01 19:26:14.812620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:14.815027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 461/947] 10.222.0.61 () {60 vars in 1140 bytes} [Fri Jul 1 19:26:14 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:14.822047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5cb77-7d7f-46cb-8466-d152a4cb4045 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:14.924589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5cb77-7d7f-46cb-8466-d152a4cb4045 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:14.958960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947557b-f3e2-46f1-b84d-65c2aa29c478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:14.959765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947557b-f3e2-46f1-b84d-65c2aa29c478 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:14.960384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947557b-f3e2-46f1-b84d-65c2aa29c478 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:14.960657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947557b-f3e2-46f1-b84d-65c2aa29c478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:14.967640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947557b-f3e2-46f1-b84d-65c2aa29c478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:14.969089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0947557b-f3e2-46f1-b84d-65c2aa29c478 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-0947557b-f3e2-46f1-b84d-65c2aa29c478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:14.983386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:14.985428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:14.987586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 487/948] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:14.991374 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:15.080644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:15.106854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a0ce-be3b-40e3-9d44-710846e85845 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:15.141063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7fe16-d973-4bf3-8594-ea1172b7412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:15.142133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7fe16-d973-4bf3-8594-ea1172b7412a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:15.142611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7fe16-d973-4bf3-8594-ea1172b7412a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:15.143076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7fe16-d973-4bf3-8594-ea1172b7412a None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:15.144017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7fe16-d973-4bf3-8594-ea1172b7412a None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:15.144510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7fe16-d973-4bf3-8594-ea1172b7412a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:15.146392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7fe16-d973-4bf3-8594-ea1172b7412a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:15.168572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 462/949] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:26:14 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:15.930696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832281-bf34-434f-a74e-0d0a832066b3 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:15.931219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832281-bf34-434f-a74e-0d0a832066b3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:15.931296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832281-bf34-434f-a74e-0d0a832066b3 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:15.932890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 488/950] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:15.938336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b4c85-f376-42c0-af3d-6eb34c614dbe None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:15.938764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b4c85-f376-42c0-af3d-6eb34c614dbe None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:15.938955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b4c85-f376-42c0-af3d-6eb34c614dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:15.956317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7b0b4c85-f376-42c0-af3d-6eb34c614dbe None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:15.957827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7b0b4c85-f376-42c0-af3d-6eb34c614dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:16.005578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362f891-9fd5-4031-99e6-13283565c8c6 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.006002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362f891-9fd5-4031-99e6-13283565c8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.006521 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362f891-9fd5-4031-99e6-13283565c8c6 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.008075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 489/951] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:16.014463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d3a4f-4ab9-4531-b088-3cefbe7424e3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.015007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d3a4f-4ab9-4531-b088-3cefbe7424e3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.015864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d3a4f-4ab9-4531-b088-3cefbe7424e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.023796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:16.030637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 463/952] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:16.038037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b34d3a4f-4ab9-4531-b088-3cefbe7424e3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:16.039446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b34d3a4f-4ab9-4531-b088-3cefbe7424e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:16.065325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b4c85-f376-42c0-af3d-6eb34c614dbe None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.110744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 490/953] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:16.137895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d3a4f-4ab9-4531-b088-3cefbe7424e3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.144826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:16.181862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b4c85-f376-42c0-af3d-6eb34c614dbe None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.224925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ac77a-9458-4a13-b5c5-2f0c2a452fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.225734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac77a-9458-4a13-b5c5-2f0c2a452fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.226045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac77a-9458-4a13-b5c5-2f0c2a452fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.226324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ac77a-9458-4a13-b5c5-2f0c2a452fb9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.226985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ac77a-9458-4a13-b5c5-2f0c2a452fb9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:16.228401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ac77a-9458-4a13-b5c5-2f0c2a452fb9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-f30ac77a-9458-4a13-b5c5-2f0c2a452fb9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:16.240564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:16.241568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:16.242628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:16.246265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 464/954] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:16.246596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d3a4f-4ab9-4531-b088-3cefbe7424e3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.247893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42390-f15a-45a5-84b7-ac80ca9424d1 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.248177 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42390-f15a-45a5-84b7-ac80ca9424d1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.248614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f42390-f15a-45a5-84b7-ac80ca9424d1 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.254654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 465/955] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:16.254654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42390-f15a-45a5-84b7-ac80ca9424d1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.277729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:16.283058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca924b-c17e-442c-a720-b6374fc0431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.284351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca924b-c17e-442c-a720-b6374fc0431d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.285024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca924b-c17e-442c-a720-b6374fc0431d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.285627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca924b-c17e-442c-a720-b6374fc0431d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.286882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca924b-c17e-442c-a720-b6374fc0431d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:16.288256 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca924b-c17e-442c-a720-b6374fc0431d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-bfca924b-c17e-442c-a720-b6374fc0431d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:16.300543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:16.301745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:16.303338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 491/956] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:16.304134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b0a28-601b-4594-9b7d-96fb3169b27e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.304134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b0a28-601b-4594-9b7d-96fb3169b27e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.304134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b0a28-601b-4594-9b7d-96fb3169b27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.322245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-613b0a28-601b-4594-9b7d-96fb3169b27e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:16.323434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-613b0a28-601b-4594-9b7d-96fb3169b27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:16.376188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f42390-f15a-45a5-84b7-ac80ca9424d1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.396142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 492/957] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:16.397316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b0a28-601b-4594-9b7d-96fb3169b27e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.416933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:16.424127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.424779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.425077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.425344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.426105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:16.426414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:16.427775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:16.433058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 466/958] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:16.433775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.510077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b0a28-601b-4594-9b7d-96fb3169b27e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.536912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:16.539160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b5760-7a09-48ff-80d6-ba7e9d1a11d7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.546384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.547072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.547313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.547595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.548309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:16.548618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:16.550004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:16.554951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 493/959] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:16.555771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.579683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e85b-2bee-46b9-875d-3e3cff8bba1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.580492 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e85b-2bee-46b9-875d-3e3cff8bba1c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.580771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e85b-2bee-46b9-875d-3e3cff8bba1c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.581043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3e85b-2bee-46b9-875d-3e3cff8bba1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.592024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3e85b-2bee-46b9-875d-3e3cff8bba1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-53b3e85b-2bee-46b9-875d-3e3cff8bba1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:16.600246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:16.601375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 467/960] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:16.602654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e85b-2bee-46b9-875d-3e3cff8bba1c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.658482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:16.664138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ba1f2-3307-487e-a102-71b437e154c0 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.701736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.702386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.702611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.702883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.703587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:16.703889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:16.705248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:16.707040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3e85b-2bee-46b9-875d-3e3cff8bba1c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.715248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 494/961] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:16.715248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.746565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.747731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.748162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.748581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.749597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:16.750471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:16.751738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:16.756452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 468/962] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:16.766993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.772203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:16.831195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a8231-7733-4b70-9ced-3a4c290f3647 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.871185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.871803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.872090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.872367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.873134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:16.873445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:16.874966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:16.884576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 495/963] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:16.890478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:16.912508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eb165-b9cd-479e-b3b9-2324e294607b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:16.932159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:16.956470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae5eb7-3732-419d-9675-db8a5d49bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:16.957298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5eb7-3732-419d-9675-db8a5d49bc1d None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:16.957677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5eb7-3732-419d-9675-db8a5d49bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:16.958074 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae5eb7-3732-419d-9675-db8a5d49bc1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:16.958926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae5eb7-3732-419d-9675-db8a5d49bc1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:16.960948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae5eb7-3732-419d-9675-db8a5d49bc1d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:16.982976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 469/964] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:26:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:17.006684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1990-6e1c-4475-8802-460a0b9d4343 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:17.026251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:17.068114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e8d58-f850-4d65-9415-9455bbc0eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:17.069353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e8d58-f850-4d65-9415-9455bbc0eade None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.069840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e8d58-f850-4d65-9415-9455bbc0eade None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.070371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e8d58-f850-4d65-9415-9455bbc0eade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.083434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e8d58-f850-4d65-9415-9455bbc0eade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:17.085675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e8d58-f850-4d65-9415-9455bbc0eade None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-022e8d58-f850-4d65-9415-9455bbc0eade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:17.105059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:17.106051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:17.106946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:17.106946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:17.106946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:17.106946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:17.109360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 496/965] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:17.115181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae5eb7-3732-419d-9675-db8a5d49bc1d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:17.219633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae5eb7-3732-419d-9675-db8a5d49bc1d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:17.228881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2258acd-34ab-4b52-85b4-6323663bd4cd None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.229167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2258acd-34ab-4b52-85b4-6323663bd4cd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.229449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2258acd-34ab-4b52-85b4-6323663bd4cd None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.231103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 497/966] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:17.235903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca596-b326-45e2-a3a1-5b9bdb1cc561 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.236200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca596-b326-45e2-a3a1-5b9bdb1cc561 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.236470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ca596-b326-45e2-a3a1-5b9bdb1cc561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.253444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-236ca596-b326-45e2-a3a1-5b9bdb1cc561 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:17.254682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-236ca596-b326-45e2-a3a1-5b9bdb1cc561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:17.257503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:17.258802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.259147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.259418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.260151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:17.260452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:17.261831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:17.277300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 470/967] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:17.283001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:17.322812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:17.340028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 498/968] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:17.364024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ca596-b326-45e2-a3a1-5b9bdb1cc561 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:17.405935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68849e3a-be43-4d2a-8919-940a9735eb82 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:17.443198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:17.444418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.444922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.445392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.454364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:17.456219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:17.472392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:17.474857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:17.478247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:17.479432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 471/969] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:26:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:17.480179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ca596-b326-45e2-a3a1-5b9bdb1cc561 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:17.483390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:17.523290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:17.523992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.524514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.524796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.525822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:17.527655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:17.529963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING keystone.server.flask.common [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 01 19:26:17.544566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.sql.core [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 19:26:17.544566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 01 19:26:17.544566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [parameters: {'user_id': 'b7ed959fa74b4251b576f633ccebc6c4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 01 19:26:17.544566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80243) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result.read() Jul 01 19:26:17.554604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:26:17.555605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application yield resource Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application next(self.gen) Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise self.value Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application session.commit() Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 19:26:17.556547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.session.flush() Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application compat.raise_( Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 19:26:17.557455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 19:26:17.558358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application conn.query(q) Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application result.read() Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 19:26:17.559204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b7ed959fa74b4251b576f633ccebc6c4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:17.560050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 01 19:26:17.560859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 01 19:26:17.561893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 01 19:26:17.561893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 01 19:26:17.561893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 19:26:17.561893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 19:26:17.561893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 01 19:26:17.561893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:17.561893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 499/970] 10.222.0.61 () {60 vars in 1131 bytes} [Fri Jul 1 19:26:17 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:17.564178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:17.619044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:17.628922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49468dfa-b993-43b2-8b5c-76f70dc0e70b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:17.673524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:17.674232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.674518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.674793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.675688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:17.675936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:17.677414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:17.679070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649acbf-d67a-4d2b-a7eb-5ca82912e627 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:17.695965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 472/971] 10.222.0.61 () {56 vars in 1149 bytes} [Fri Jul 1 19:26:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:17.702232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:17.720234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:17.721482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.722009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.722842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.732797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:17.735447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:17.756865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:17.757892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 19:26:17.759010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:17.762020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 500/972] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:26:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:17.765249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:17.789016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:17.821603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569a826-edc1-49b9-8e1d-c0bd2456d059 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:17.861814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd3515-1ad4-4c07-bf25-e78b0e237d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:17.862885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd3515-1ad4-4c07-bf25-e78b0e237d9b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.862885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd3515-1ad4-4c07-bf25-e78b0e237d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.863147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd3515-1ad4-4c07-bf25-e78b0e237d9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.888739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:17.896702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f56b9-3313-4eaf-984e-c707fb4e1f32 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:17.938945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:17.940031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:17.940537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:17.941325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:17.943109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:17.944082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:17.944805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd3515-1ad4-4c07-bf25-e78b0e237d9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:17.946226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:17.946445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd3515-1ad4-4c07-bf25-e78b0e237d9b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:17.994452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 501/973] 10.222.0.61 () {56 vars in 1101 bytes} [Fri Jul 1 19:26:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:18.059208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 473/974] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:17 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:18.064872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:18.152128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:18.183836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3dfb8-7f5a-418e-a6cf-879f0ed49b69 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:18.221179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:18.222007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:18.222296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:18.222575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:18.234004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:18.235465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:18.253894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:18.254850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:18.255757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:18.255757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:18.255757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:18.255757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:18.255757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 502/975] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:18.261391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd3515-1ad4-4c07-bf25-e78b0e237d9b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:18.318738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:18.369725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd3515-1ad4-4c07-bf25-e78b0e237d9b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:18.404116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:18.404783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:18.405072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:18.405348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:18.406101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:18.406502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:18.407953 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:18.420145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 474/976] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:18.425754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:18.530365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712e9b2-878b-4f43-a255-66857bcd6f45 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:18.557516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:18.568595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:18.569407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:18.569684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:18.569983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:18.577610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:18.579087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:18.593483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:18.594416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:18.595313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:18.595313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:18.595313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:18.595313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:18.595313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:18.595313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:18.595313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:18.595313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:18.599706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 503/977] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:18.601098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:18.709056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4aa1d-0382-4db7-a468-de967a6572a2 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:18.722913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:18.745403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472520f-f33c-4704-9ed8-8a2877382636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:18.746181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472520f-f33c-4704-9ed8-8a2877382636 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:18.746461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472520f-f33c-4704-9ed8-8a2877382636 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:18.746734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472520f-f33c-4704-9ed8-8a2877382636 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:18.747520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472520f-f33c-4704-9ed8-8a2877382636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:18.747829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472520f-f33c-4704-9ed8-8a2877382636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:18.749265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472520f-f33c-4704-9ed8-8a2877382636 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:18.762401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 475/978] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:18.768144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:18.873529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbb578-9398-4b16-859d-0930d3c83306 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:18.887674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1e56e-8ee6-4a0c-be73-5cc9be5af75d None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:18.887941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1e56e-8ee6-4a0c-be73-5cc9be5af75d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:18.888219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1e56e-8ee6-4a0c-be73-5cc9be5af75d None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:18.889862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 476/979] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:18.894523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c87c-fe41-4434-b549-1757d602f66c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:18.894824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c87c-fe41-4434-b549-1757d602f66c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:18.895082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c87c-fe41-4434-b549-1757d602f66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:18.908916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:18.909587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:18.909877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:18.910174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:18.910990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] RBAC: Adding query filter params (role.id=b09f5867b4d8422dbbbbdb67ed9e8743, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=bd7b6bcd191f45d39f6c5e5a6bf7646a) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:18.911319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:18.912020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c1b2c87c-fe41-4434-b549-1757d602f66c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:18.912741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:18.913207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c1b2c87c-fe41-4434-b549-1757d602f66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:18.919789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 504/980] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:18 2022] GET /identity/v3/role_assignments?user.id=bd7b6bcd191f45d39f6c5e5a6bf7646a&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=b09f5867b4d8422dbbbbdb67ed9e8743 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:18.986065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 477/981] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:19.008920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:19.067960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:19.112483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07ee23-7850-4d7a-987b-b6a06ec66869 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:19.113406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07ee23-7850-4d7a-987b-b6a06ec66869 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:19.113858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07ee23-7850-4d7a-987b-b6a06ec66869 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:19.115264 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 478/982] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:19.120506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b141d-8196-45df-b0de-4f859e5fecb8 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:19.120792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b141d-8196-45df-b0de-4f859e5fecb8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:19.121067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b141d-8196-45df-b0de-4f859e5fecb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:19.127158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af405d39-168a-49c7-a40b-2299fae75b27 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:19.137872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-579b141d-8196-45df-b0de-4f859e5fecb8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:19.139076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-579b141d-8196-45df-b0de-4f859e5fecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:19.162808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe50d4-9eed-48a4-ad05-907f8652cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:19.163476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe50d4-9eed-48a4-ad05-907f8652cb19 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:19.163761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe50d4-9eed-48a4-ad05-907f8652cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:19.164042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe50d4-9eed-48a4-ad05-907f8652cb19 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:19.164802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe50d4-9eed-48a4-ad05-907f8652cb19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:19.166188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe50d4-9eed-48a4-ad05-907f8652cb19 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:19.181467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 505/983] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:26:19 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:26:19.216646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 479/984] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:19.241995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe50d4-9eed-48a4-ad05-907f8652cb19 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:19.354368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe50d4-9eed-48a4-ad05-907f8652cb19 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:19.365043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:19.389660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:19.390507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:19.390791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:19.391070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:19.391730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:19.393099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:19.405479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:19.406519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:19.407356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 506/985] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:19.414467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b141d-8196-45df-b0de-4f859e5fecb8 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:19.445327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:19.521207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b141d-8196-45df-b0de-4f859e5fecb8 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:19.556705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:19.557367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:19.557649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:19.557929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:19.558664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:19.558966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:19.560341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:19.565856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 480/986] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:19.571469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:19.677252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2ff68-e7c5-4f96-b9eb-380e974b11d2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:19.712771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:19.713455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:19.713736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:19.714497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:19.715175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:19.716066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:19.717450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:19.723084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 507/987] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:19.729119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:19.826654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:19.837164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23935-b811-40cc-a2d5-a66b07805777 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:19.872844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaaf62-1123-44c1-b4ac-ec16ac7d8b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:19.873595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaaf62-1123-44c1-b4ac-ec16ac7d8b49 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:19.873918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaaf62-1123-44c1-b4ac-ec16ac7d8b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:19.874312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaaf62-1123-44c1-b4ac-ec16ac7d8b49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:19.875217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaaf62-1123-44c1-b4ac-ec16ac7d8b49 None admin] RBAC: Adding query filter params (interface=admin, service_id=d0fb7bd83c2244638a40c99573f0af4b, region_id=RegionOne) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:19.875598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaaf62-1123-44c1-b4ac-ec16ac7d8b49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:19.877023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaaf62-1123-44c1-b4ac-ec16ac7d8b49 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:19.882456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 481/988] 10.222.0.61 () {56 vars in 1249 bytes} [Fri Jul 1 19:26:19 2022] GET /identity/v3/endpoints?service_id=d0fb7bd83c2244638a40c99573f0af4b&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:19.889552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:19.933850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:19.995786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae3778-f2d8-479d-be12-bef09aaeb3db None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:20.029743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31027d21-a928-4ef8-973c-0faaec9c5274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:20.030443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027d21-a928-4ef8-973c-0faaec9c5274 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:20.030729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027d21-a928-4ef8-973c-0faaec9c5274 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:20.031004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31027d21-a928-4ef8-973c-0faaec9c5274 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:20.031684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31027d21-a928-4ef8-973c-0faaec9c5274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:20.033043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31027d21-a928-4ef8-973c-0faaec9c5274 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:20.039555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 508/989] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:26:19 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:26:20.986744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06baa-5dbe-44c8-8ae6-77f084451e92 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:20.987289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06baa-5dbe-44c8-8ae6-77f084451e92 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:20.987363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c06baa-5dbe-44c8-8ae6-77f084451e92 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:20.988946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 482/990] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:20.995234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edc20e-9658-4bcf-b57e-f6e5bfa346ab None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:20.995713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edc20e-9658-4bcf-b57e-f6e5bfa346ab None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:20.996244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edc20e-9658-4bcf-b57e-f6e5bfa346ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.014043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c0edc20e-9658-4bcf-b57e-f6e5bfa346ab None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:21.015695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c0edc20e-9658-4bcf-b57e-f6e5bfa346ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:21.093620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 509/991] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:21.117215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06baa-5dbe-44c8-8ae6-77f084451e92 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:21.222791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c06baa-5dbe-44c8-8ae6-77f084451e92 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:21.230954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4f3f-aa63-4cf8-a47e-1c27f927e7c8 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:21.231249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4f3f-aa63-4cf8-a47e-1c27f927e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:21.231529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce4f3f-aa63-4cf8-a47e-1c27f927e7c8 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.232918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 510/992] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:21.238096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593aff-dfa8-4fc9-bb99-fef7aa35c096 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:21.238321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593aff-dfa8-4fc9-bb99-fef7aa35c096 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:21.238598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f593aff-dfa8-4fc9-bb99-fef7aa35c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.256766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1f593aff-dfa8-4fc9-bb99-fef7aa35c096 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:21.258063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1f593aff-dfa8-4fc9-bb99-fef7aa35c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:21.260339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:21.261149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:21.261429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:21.261701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] PATH_INFO: `/v3/services/image` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.262401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:21.263777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:21.276165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:21.277178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:21.278102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 483/993] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jul 1 19:26:21 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:21.283291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:21.290952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:21.309347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:21.338962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 511/994] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:21.362233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f593aff-dfa8-4fc9-bb99-fef7aa35c096 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:21.402444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0ff10-fbfd-47f9-8388-8dfce0a3e97b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:21.436780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:21.437438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:21.437720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:21.438020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.438731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] RBAC: Adding query filter params (name=image) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:21.439036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:21.440399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:21.449844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 484/995] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:21.450779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:21.472334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f593aff-dfa8-4fc9-bb99-fef7aa35c096 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:21.506930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:21.507744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:21.508025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:21.508478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.509135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:21.510686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:21.523380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:21.524482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:21.525537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 512/996] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:21.530525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:21.542951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:21.560124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149203a9-890a-41fa-943e-90e2de1a201c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:21.560322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:21.596906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:21.597790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:21.598103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:21.598377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.599089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] RBAC: Adding query filter params (type=image) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:21.599391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:21.600772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:21.614497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 485/997] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:21 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:21.638798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0a4d2-9805-4c4e-8362-12300e48b833 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:21.678222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:21.679298 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:21.679766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:21.680277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.681176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:21.681675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:21.683282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:21.689707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 513/998] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:26:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:21.695357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:21.815557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa98aa-153f-4542-9cbf-d3857205adae None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:21.849267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:21.849936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:21.850246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:21.850521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:21.851233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:21.851538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:21.852955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:21.858121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 486/999] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:26:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:21.863804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:21.959567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:21.971683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831be83-7ee2-4e12-a213-e550fbcdee6a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:22.006600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c565a-52fa-43f0-bc64-ba110617fbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:22.007268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c565a-52fa-43f0-bc64-ba110617fbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:22.007512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c565a-52fa-43f0-bc64-ba110617fbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:22.007795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c565a-52fa-43f0-bc64-ba110617fbc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:22.008609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c565a-52fa-43f0-bc64-ba110617fbc7 None admin] RBAC: Adding query filter params (interface=public, service_id=c99983c637174d8092514818e554e31d, region_id=RegionOne) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:22.008920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c565a-52fa-43f0-bc64-ba110617fbc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:22.010310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c565a-52fa-43f0-bc64-ba110617fbc7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:22.020366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 514/1000] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jul 1 19:26:21 2022] GET /identity/v3/endpoints?service_id=c99983c637174d8092514818e554e31d&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:22.021790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:22.038539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:22.113986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bd8d2-20da-4b3a-b87d-4cbbf954cb4f None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:22.114297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bd8d2-20da-4b3a-b87d-4cbbf954cb4f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:22.114480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bd8d2-20da-4b3a-b87d-4cbbf954cb4f None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:22.116448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 515/1001] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:22.122150 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfd5f4-ccd9-4093-be70-896c5083ebe0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:22.122455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfd5f4-ccd9-4093-be70-896c5083ebe0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:22.122702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfd5f4-ccd9-4093-be70-896c5083ebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:22.140783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-03cfd5f4-ccd9-4093-be70-896c5083ebe0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:22.142033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-03cfd5f4-ccd9-4093-be70-896c5083ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:22.147682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864695-79b7-422b-8671-d3dd9b731b0f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:22.187447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e57787-b6ad-4cd4-9ece-e2c475c9a186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:22.188454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e57787-b6ad-4cd4-9ece-e2c475c9a186 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:22.188734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e57787-b6ad-4cd4-9ece-e2c475c9a186 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:22.189014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e57787-b6ad-4cd4-9ece-e2c475c9a186 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:22.190105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e57787-b6ad-4cd4-9ece-e2c475c9a186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:22.191707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e57787-b6ad-4cd4-9ece-e2c475c9a186 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:22.198932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 487/1002] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:26:22 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:26:22.226668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 516/1003] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:22.250559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e57787-b6ad-4cd4-9ece-e2c475c9a186 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:22.340584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:22.368996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e57787-b6ad-4cd4-9ece-e2c475c9a186 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:22.403699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:22.404522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:22.404818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:22.405085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:22.405733 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:22.407135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:22.419487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:22.420502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:22.421330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 488/1004] 10.222.0.61 () {56 vars in 1126 bytes} [Fri Jul 1 19:26:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:22.427092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfd5f4-ccd9-4093-be70-896c5083ebe0 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:22.512567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:22.530422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfd5f4-ccd9-4093-be70-896c5083ebe0 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:22.565129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:22.565786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:22.566092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:22.566367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:22.567071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:22.567375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:22.568720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:22.573787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 517/1005] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:22.579504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:22.682826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2075be7-591f-4ab0-9135-3f760dc5be67 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:22.718498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660d43e-1e66-424c-a58e-fd9399af6cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:22.719250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d43e-1e66-424c-a58e-fd9399af6cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:22.719530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d43e-1e66-424c-a58e-fd9399af6cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:22.719806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660d43e-1e66-424c-a58e-fd9399af6cd2 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:22.720539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660d43e-1e66-424c-a58e-fd9399af6cd2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:22.720847 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660d43e-1e66-424c-a58e-fd9399af6cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:22.722358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660d43e-1e66-424c-a58e-fd9399af6cd2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:22.728501 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 489/1006] 10.222.0.61 () {56 vars in 1122 bytes} [Fri Jul 1 19:26:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:22.734163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:22.837646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820d11d-1459-41f7-bbc2-20ac4340050b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:22.872524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6349-2bc1-4923-976a-a2d0209680f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:22.873171 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6349-2bc1-4923-976a-a2d0209680f3 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:22.873447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6349-2bc1-4923-976a-a2d0209680f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:22.873728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6349-2bc1-4923-976a-a2d0209680f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:22.874487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee6349-2bc1-4923-976a-a2d0209680f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:22.875831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee6349-2bc1-4923-976a-a2d0209680f3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:22.896807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 518/1007] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:26:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:23.634201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f258cb-b7a6-4e38-a100-c499da3eff46 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:23.634761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f258cb-b7a6-4e38-a100-c499da3eff46 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:23.634761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f258cb-b7a6-4e38-a100-c499da3eff46 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:23.636286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 490/1008] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:23.641315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb014-ce46-4fa5-9b12-b91b9384d5f9 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:23.641773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb014-ce46-4fa5-9b12-b91b9384d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:23.641852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfb014-ce46-4fa5-9b12-b91b9384d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:23.659115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2ccfb014-ce46-4fa5-9b12-b91b9384d5f9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:23.660270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2ccfb014-ce46-4fa5-9b12-b91b9384d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:23.662666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:23.737052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 519/1009] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:23 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:23.759644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f258cb-b7a6-4e38-a100-c499da3eff46 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:23.764623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:23.868249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f258cb-b7a6-4e38-a100-c499da3eff46 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:23.902193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3c29c-42a8-43bb-9f78-57ca0ba44d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:23.902777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c29c-42a8-43bb-9f78-57ca0ba44d5d None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:23.903057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c29c-42a8-43bb-9f78-57ca0ba44d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:23.903332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3c29c-42a8-43bb-9f78-57ca0ba44d5d None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:23.904065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3c29c-42a8-43bb-9f78-57ca0ba44d5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:23.905432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3c29c-42a8-43bb-9f78-57ca0ba44d5d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:23.921904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 491/1010] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:26:23 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:26:24.251321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136119-54b6-42dc-95a8-928bf1f3a252 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:24.251629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136119-54b6-42dc-95a8-928bf1f3a252 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:24.251843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136119-54b6-42dc-95a8-928bf1f3a252 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:24.253210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 520/1011] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:24.258659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c2d6-a930-43ae-a273-3a72f0e580cc None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:24.258931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c2d6-a930-43ae-a273-3a72f0e580cc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:24.259209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c2d6-a930-43ae-a273-3a72f0e580cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:24.276158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5801c2d6-a930-43ae-a273-3a72f0e580cc None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:24.277334 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5801c2d6-a930-43ae-a273-3a72f0e580cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:24.337496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:24.353268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 492/1012] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:24 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:24.376080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136119-54b6-42dc-95a8-928bf1f3a252 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:24.485874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136119-54b6-42dc-95a8-928bf1f3a252 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:24.521737 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:24.522517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:24.522794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:24.523112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] PATH_INFO: `/v3/services/compute` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:24.523762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:24.525195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:24.527086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:24.539514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:24.540897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 19:26:24.541722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:24.543040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 521/1013] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:24.547235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c2d6-a930-43ae-a273-3a72f0e580cc None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:24.656663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801c2d6-a930-43ae-a273-3a72f0e580cc None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:24.691512 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:24.692166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:24.692444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:24.692715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:24.693418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:24.693718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:24.695306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:24.700575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 493/1014] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:26:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:24.706384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:24.808404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d2a925-dfac-4746-95b8-45ddae0416be None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:24.841980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c91d7-0974-481f-ab20-280978155764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:24.842645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c91d7-0974-481f-ab20-280978155764 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:24.842927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c91d7-0974-481f-ab20-280978155764 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:24.843198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c91d7-0974-481f-ab20-280978155764 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:24.843899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c91d7-0974-481f-ab20-280978155764 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:24.844200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c91d7-0974-481f-ab20-280978155764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:24.845561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c91d7-0974-481f-ab20-280978155764 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:24.850785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 522/1015] 10.222.0.61 () {56 vars in 1112 bytes} [Fri Jul 1 19:26:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:24.856523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:24.913454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:24.935222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79e2b3-3332-4c7c-9adb-82a9769c74de None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:24.935449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79e2b3-3332-4c7c-9adb-82a9769c74de None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:24.935759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79e2b3-3332-4c7c-9adb-82a9769c74de None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:24.937113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 523/1016] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:24.942322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cdb1-50c9-4cd4-9ba9-7287e5c7a260 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:24.942616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cdb1-50c9-4cd4-9ba9-7287e5c7a260 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:24.942899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388cdb1-50c9-4cd4-9ba9-7287e5c7a260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:24.960538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2388cdb1-50c9-4cd4-9ba9-7287e5c7a260 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:24.961818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2388cdb1-50c9-4cd4-9ba9-7287e5c7a260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:24.963944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b262d-6707-4d41-85b1-ea483b7e4e41 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:24.998902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b311b7d-2465-4b8a-bccd-cc7e92143469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:24.999550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b311b7d-2465-4b8a-bccd-cc7e92143469 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:24.999823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b311b7d-2465-4b8a-bccd-cc7e92143469 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:25.000241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b311b7d-2465-4b8a-bccd-cc7e92143469 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:25.000995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b311b7d-2465-4b8a-bccd-cc7e92143469 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:25.002387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b311b7d-2465-4b8a-bccd-cc7e92143469 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:25.021878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 494/1017] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:26:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:26:25.031932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:25.052525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 524/1018] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:25.077491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b311b7d-2465-4b8a-bccd-cc7e92143469 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:25.192292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b311b7d-2465-4b8a-bccd-cc7e92143469 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:25.204348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:25.231477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d88eb8-5b29-414f-8209-f1de28fcc7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:25.232256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88eb8-5b29-414f-8209-f1de28fcc7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:25.232540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88eb8-5b29-414f-8209-f1de28fcc7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:25.232823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d88eb8-5b29-414f-8209-f1de28fcc7d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:25.234009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d88eb8-5b29-414f-8209-f1de28fcc7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:25.235449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d88eb8-5b29-414f-8209-f1de28fcc7d1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:25.237092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 495/1019] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:25.243553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388cdb1-50c9-4cd4-9ba9-7287e5c7a260 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:25.354188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388cdb1-50c9-4cd4-9ba9-7287e5c7a260 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:25.390207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04f730-0ebb-4fd0-9e21-107ee4539b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:25.390872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04f730-0ebb-4fd0-9e21-107ee4539b9b None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:25.391154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04f730-0ebb-4fd0-9e21-107ee4539b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:25.391434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04f730-0ebb-4fd0-9e21-107ee4539b9b None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:25.392164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04f730-0ebb-4fd0-9e21-107ee4539b9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:25.393595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be04f730-0ebb-4fd0-9e21-107ee4539b9b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:25.420225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 525/1020] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:26:25 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:25.962881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80eb1-de71-4245-8f00-9f6e34aef990 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:25.963875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80eb1-de71-4245-8f00-9f6e34aef990 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:25.964380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d80eb1-de71-4245-8f00-9f6e34aef990 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:25.966867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 496/1021] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:25.971763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f536e6f-c984-4022-a5c8-0bf5822d554a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:25.972225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f536e6f-c984-4022-a5c8-0bf5822d554a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:25.972305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f536e6f-c984-4022-a5c8-0bf5822d554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:25.989251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6f536e6f-c984-4022-a5c8-0bf5822d554a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:25.990448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6f536e6f-c984-4022-a5c8-0bf5822d554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:26.026807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:26.070740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 526/1022] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:26.093582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d80eb1-de71-4245-8f00-9f6e34aef990 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:26.195979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d80eb1-de71-4245-8f00-9f6e34aef990 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:26.230408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:26.231116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:26.231401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:26.231674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] PATH_INFO: `/v3/services/image` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:26.232327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:26.233709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:26.246059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:26.247148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:26.247993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 497/1023] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jul 1 19:26:26 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:26.253380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f536e6f-c984-4022-a5c8-0bf5822d554a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:26.356642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f536e6f-c984-4022-a5c8-0bf5822d554a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:26.394278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:26.394942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:26.395227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:26.395501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:26.396235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] RBAC: Adding query filter params (name=image) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:26.396540 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:26.397960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:26.403377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 527/1024] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:26.408909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:26.452949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:26.511903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472cd5e-4efa-4d1c-b4aa-00e2c85dafdf None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:26.546095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:26.546784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:26.547068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:26.547338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:26.548062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:26.548370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:26.549783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:26.555729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 498/1025] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:26.561676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:26.596547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:26.663869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715757dc-84af-4d1e-b0aa-c0db289a6590 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:26.697772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ab962-cd83-4975-9c63-708a98f9ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:26.698454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab962-cd83-4975-9c63-708a98f9ad1c None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:26.698739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab962-cd83-4975-9c63-708a98f9ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:26.699016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab962-cd83-4975-9c63-708a98f9ad1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:26.699804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab962-cd83-4975-9c63-708a98f9ad1c None admin] RBAC: Adding query filter params (interface=public, service_id=202d4a2dec9e48988e244f22cabc2794, region_id=RegionOne) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:26.700110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab962-cd83-4975-9c63-708a98f9ad1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:26.701474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab962-cd83-4975-9c63-708a98f9ad1c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:26.706838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 528/1026] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jul 1 19:26:26 2022] GET /identity/v3/endpoints?service_id=202d4a2dec9e48988e244f22cabc2794&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:26.712802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:26.825329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd44566-195a-45f1-af56-9e63a46316d9 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:26.832457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:26.860484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3601c-7c05-4bee-a263-b9ed173b1e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:26.861152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3601c-7c05-4bee-a263-b9ed173b1e69 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:26.861427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3601c-7c05-4bee-a263-b9ed173b1e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:26.861697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3601c-7c05-4bee-a263-b9ed173b1e69 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:26.862414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3601c-7c05-4bee-a263-b9ed173b1e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:26.863794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3601c-7c05-4bee-a263-b9ed173b1e69 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:26.875961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 499/1027] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:26:26 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:26:27.168833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc4b7-6a54-47b8-934a-db3c5ec0df85 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.169374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc4b7-6a54-47b8-934a-db3c5ec0df85 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.169374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dc4b7-6a54-47b8-934a-db3c5ec0df85 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.170739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 529/1028] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:27.176341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6523ff-dbac-4005-bfc3-d869e924a022 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.176764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6523ff-dbac-4005-bfc3-d869e924a022 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.176861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6523ff-dbac-4005-bfc3-d869e924a022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.194285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ec6523ff-dbac-4005-bfc3-d869e924a022 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:27.195448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ec6523ff-dbac-4005-bfc3-d869e924a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:27.264440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 500/1029] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:27.287502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dc4b7-6a54-47b8-934a-db3c5ec0df85 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:27.391254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:27.397090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dc4b7-6a54-47b8-934a-db3c5ec0df85 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:27.431786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e40ef-266f-4c9f-9c18-0fcc473aa62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:27.432570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e40ef-266f-4c9f-9c18-0fcc473aa62d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.432861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e40ef-266f-4c9f-9c18-0fcc473aa62d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.433140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e40ef-266f-4c9f-9c18-0fcc473aa62d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.443371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e40ef-266f-4c9f-9c18-0fcc473aa62d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-608e40ef-266f-4c9f-9c18-0fcc473aa62d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:27.451660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:27.452600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:27.453517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:27.454838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 530/1030] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jul 1 19:26:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:27.458822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6523ff-dbac-4005-bfc3-d869e924a022 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:27.459378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c755-0ac4-4981-a064-bb18ee969c68 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.459665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c755-0ac4-4981-a064-bb18ee969c68 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.460300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722c755-0ac4-4981-a064-bb18ee969c68 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.461785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 531/1031] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:27.466461 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde95a47-8c09-49be-b986-0052afb35bfe None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.466749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde95a47-8c09-49be-b986-0052afb35bfe None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.467028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde95a47-8c09-49be-b986-0052afb35bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.483456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-fde95a47-8c09-49be-b986-0052afb35bfe None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:27.484635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fde95a47-8c09-49be-b986-0052afb35bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:27.557924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 532/1032] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:27.563664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:27.567186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6523ff-dbac-4005-bfc3-d869e924a022 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:27.584449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde95a47-8c09-49be-b986-0052afb35bfe None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:27.605510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:27.606224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.606500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.606776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.607519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:27.607823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:27.609215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:27.618774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 501/1033] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jul 1 19:26:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:27.623822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:27.675750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:27.688152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde95a47-8c09-49be-b986-0052afb35bfe None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:27.725370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1954b0-96ff-4ce9-a27c-073aeb2c5316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:27.726195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1954b0-96ff-4ce9-a27c-073aeb2c5316 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.726402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500f066-e2b8-4338-a620-6d889786c6a5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:27.726509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1954b0-96ff-4ce9-a27c-073aeb2c5316 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.726740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1954b0-96ff-4ce9-a27c-073aeb2c5316 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.727990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1954b0-96ff-4ce9-a27c-073aeb2c5316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:27.729437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1954b0-96ff-4ce9-a27c-073aeb2c5316 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:27.731101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 533/1034] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:27.736667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1954b0-96ff-4ce9-a27c-073aeb2c5316 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:27.763494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:27.764284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.764561 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.764827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.776379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:27.777853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:27.799294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:27.800217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:27.801109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:27.801109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:27.801109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:27.801109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:27.801109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 502/1035] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:27.806576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:27.823454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:27.854091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1954b0-96ff-4ce9-a27c-073aeb2c5316 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:27.896282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766a62-4d5c-4183-96e1-991d4fae0474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:27.896964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766a62-4d5c-4183-96e1-991d4fae0474 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.897250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766a62-4d5c-4183-96e1-991d4fae0474 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.897529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766a62-4d5c-4183-96e1-991d4fae0474 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.898281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8766a62-4d5c-4183-96e1-991d4fae0474 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:27.899774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8766a62-4d5c-4183-96e1-991d4fae0474 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:27.925052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 534/1036] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:26:27 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:26:27.926063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b1bae-0a4b-404f-987e-1616a0e3a2cd None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:27.971215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:27.971937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:27.972241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:27.972496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:27.973256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:27.973563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:27.975104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:27.990613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 503/1037] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:27.996564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766a62-4d5c-4183-96e1-991d4fae0474 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:28.014949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:28.120976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766a62-4d5c-4183-96e1-991d4fae0474 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:28.155884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:28.156688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:28.156967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:28.157240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:28.165241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:28.166714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:28.180902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:28.182315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:28.183244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 535/1038] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:26:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:28.188255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:28.265982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:28.292997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb471294-ec5e-446c-8b85-ce35d6b2ce5e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:28.327318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:28.327987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:28.328270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:28.328546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:28.329379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:28.329685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:28.331146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:28.349903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 504/1039] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:26:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:28.355601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:28.427200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:28.458875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047ef48-8b3a-480f-bc6f-7191a7f8053f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:28.494397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea327dc-5447-425b-ba6c-96bd9b32596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:28.495045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea327dc-5447-425b-ba6c-96bd9b32596f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:28.495297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea327dc-5447-425b-ba6c-96bd9b32596f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:28.495602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea327dc-5447-425b-ba6c-96bd9b32596f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:28.565502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea327dc-5447-425b-ba6c-96bd9b32596f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:28.566889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea327dc-5447-425b-ba6c-96bd9b32596f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:28.635109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:28.669981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 536/1040] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:28 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:28.673062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:28.776940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a828d5-e4ba-4944-8ec3-e7da4d7d8de8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:28.808362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:28.814551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b149c-399f-49a0-94bb-64dae9685cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:28.815349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b149c-399f-49a0-94bb-64dae9685cca None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:28.815683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b149c-399f-49a0-94bb-64dae9685cca None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:28.815911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b149c-399f-49a0-94bb-64dae9685cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:28.826958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b149c-399f-49a0-94bb-64dae9685cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:28.828405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b149c-399f-49a0-94bb-64dae9685cca None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-284b149c-399f-49a0-94bb-64dae9685cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:28.846720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:28.847634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:28.848605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:28.848605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:28.848605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:28.848605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:28.850309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 505/1041] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:28.853698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea327dc-5447-425b-ba6c-96bd9b32596f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:28.887539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ec9c-c343-49f1-b31a-7635e51817fb None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:28.887894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ec9c-c343-49f1-b31a-7635e51817fb None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:28.888111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462ec9c-c343-49f1-b31a-7635e51817fb None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:28.889464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 506/1042] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:28.894462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f770-637e-4566-b820-8dac39c9934b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:28.894743 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f770-637e-4566-b820-8dac39c9934b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:28.895017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7f770-637e-4566-b820-8dac39c9934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:28.914561 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d7c7f770-637e-4566-b820-8dac39c9934b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:28.916033 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d7c7f770-637e-4566-b820-8dac39c9934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:28.962025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea327dc-5447-425b-ba6c-96bd9b32596f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:28.990014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 507/1043] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:28.998240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:28.998898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:28.999177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:28.999446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:29.000162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:29.000463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:29.001818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:29.017745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7f770-637e-4566-b820-8dac39c9934b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:29.017973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 537/1044] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:29.019166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:29.055154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:29.124874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7f770-637e-4566-b820-8dac39c9934b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:29.136600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d291fe6-ce37-4237-9eed-eb0f1e01d1e8 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:29.140691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:29.163200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:29.163988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:29.164279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:29.164529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:29.165365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:29.166765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:29.172727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:29.173521 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:29.173805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:29.174112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:29.178432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:29.179407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:29.185348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 508/1045] 10.222.0.61 () {56 vars in 1105 bytes} [Fri Jul 1 19:26:29 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:29.186177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:29.186177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:29.186655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:29.197637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:29.198643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:29.199794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 538/1046] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:29.204520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:29.293934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a4631-4551-4e49-a6d6-3d51295a53d6 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:29.302966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:29.312728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592c200-3a45-4b5a-bbe6-1441315419a8 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:29.330218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:29.330882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:29.331162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:29.331432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:29.332127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] RBAC: Adding query filter params (name=image) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:29.332429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:29.333790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:29.339738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 509/1047] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:29.345097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:29.350888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:29.351549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:29.351835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:29.352235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:29.353025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:29.353338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:29.354784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:29.366470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 539/1048] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:29.372147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:29.390947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:29.450847 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983426b-06ce-4160-900b-3c5a6397c098 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:29.470892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fe685-953d-4680-90be-787aa0ca0102 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:29.487147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:29.487808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:29.488085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:29.488357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:29.489061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] RBAC: Adding query filter params (type=image) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:29.489365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:29.490764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:29.495988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 510/1049] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:29.501324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:29.506543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bbef8-368d-4735-b916-83a8d436f7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:29.507192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bbef8-368d-4735-b916-83a8d436f7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:29.507471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bbef8-368d-4735-b916-83a8d436f7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:29.507743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bbef8-368d-4735-b916-83a8d436f7b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:29.508599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bbef8-368d-4735-b916-83a8d436f7b9 None admin] RBAC: Adding query filter params (role.id=b09f5867b4d8422dbbbbdb67ed9e8743, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=d78ccd9541dc48cfbdfc116dcec91a2f) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:29.508911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bbef8-368d-4735-b916-83a8d436f7b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:29.510355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bbef8-368d-4735-b916-83a8d436f7b9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:29.516010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 540/1050] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:29 2022] GET /identity/v3/role_assignments?user.id=d78ccd9541dc48cfbdfc116dcec91a2f&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=b09f5867b4d8422dbbbbdb67ed9e8743 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:29.623977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870af24b-91fc-4258-a5c7-37eeb8a5f543 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:29.631860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:29.662724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12e1a-90b0-4a25-a95d-981d5aff0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:29.663297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12e1a-90b0-4a25-a95d-981d5aff0c98 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:29.663572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12e1a-90b0-4a25-a95d-981d5aff0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:29.663844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12e1a-90b0-4a25-a95d-981d5aff0c98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:29.664656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b12e1a-90b0-4a25-a95d-981d5aff0c98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:29.666081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b12e1a-90b0-4a25-a95d-981d5aff0c98 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:29.690403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 511/1051] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:26:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:26:30.061344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e7e71-28c3-47e6-9ffd-6fc160649b47 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:30.061446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e7e71-28c3-47e6-9ffd-6fc160649b47 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:30.061730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e7e71-28c3-47e6-9ffd-6fc160649b47 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:30.063327 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 541/1052] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:30.068625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaee0f-1ee0-4123-9e4b-6815dc8f1ab9 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:30.068921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaee0f-1ee0-4123-9e4b-6815dc8f1ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:30.069168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaee0f-1ee0-4123-9e4b-6815dc8f1ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:30.087840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3dfaee0f-1ee0-4123-9e4b-6815dc8f1ab9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:30.089026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3dfaee0f-1ee0-4123-9e4b-6815dc8f1ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:30.167320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 512/1053] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:30.189511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e7e71-28c3-47e6-9ffd-6fc160649b47 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:30.209141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:30.300751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e7e71-28c3-47e6-9ffd-6fc160649b47 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:30.334630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a544f9e-abf2-45ee-b4ce-183db7096258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:30.335697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a544f9e-abf2-45ee-b4ce-183db7096258 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:30.335976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a544f9e-abf2-45ee-b4ce-183db7096258 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:30.336246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a544f9e-abf2-45ee-b4ce-183db7096258 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:30.346685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a544f9e-abf2-45ee-b4ce-183db7096258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-3a544f9e-abf2-45ee-b4ce-183db7096258 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:30.354439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:30.355375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:30.356234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:30.357657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 542/1054] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:30.361646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaee0f-1ee0-4123-9e4b-6815dc8f1ab9 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:30.451473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:30.467135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaee0f-1ee0-4123-9e4b-6815dc8f1ab9 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:30.503148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:30.503814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:30.504075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:30.504378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:30.505123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:30.505418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:30.506879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:30.520069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 513/1055] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:30.521719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a544f9e-abf2-45ee-b4ce-183db7096258 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:30.604627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:30.630414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a544f9e-abf2-45ee-b4ce-183db7096258 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:30.666116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dee8e-7a41-4cbc-93d7-5116d64451ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:30.666975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dee8e-7a41-4cbc-93d7-5116d64451ad None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:30.667254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dee8e-7a41-4cbc-93d7-5116d64451ad None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:30.667531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dee8e-7a41-4cbc-93d7-5116d64451ad None admin] PATH_INFO: `/v3/users/433aa93b19b74d08b8b370f87313d6e3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:30.681878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dee8e-7a41-4cbc-93d7-5116d64451ad None admin] RBAC: Authorizing `identity:get_user(user_id=433aa93b19b74d08b8b370f87313d6e3)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:30.683358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3dee8e-7a41-4cbc-93d7-5116d64451ad None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:30.689662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 543/1056] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:30 2022] GET /identity/v3/users/433aa93b19b74d08b8b370f87313d6e3 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:30.691209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:30.792145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f854e070-2678-4bd4-b3c3-7c8e610ac51b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:30.829010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dc28e-ba3d-47fb-ba39-194b052000d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:30.829710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dc28e-ba3d-47fb-ba39-194b052000d5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:30.830028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dc28e-ba3d-47fb-ba39-194b052000d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:30.830305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dc28e-ba3d-47fb-ba39-194b052000d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:30.849437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:30.899444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dc28e-ba3d-47fb-ba39-194b052000d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:30.900895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dc28e-ba3d-47fb-ba39-194b052000d5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:31.014545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 514/1057] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:31.016249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dee8e-7a41-4cbc-93d7-5116d64451ad None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:31.128089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dee8e-7a41-4cbc-93d7-5116d64451ad None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:31.162675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d9480-9d84-4ed5-9779-55148004e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:31.163454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9480-9d84-4ed5-9779-55148004e4ef None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:31.163733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9480-9d84-4ed5-9779-55148004e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:31.164012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d9480-9d84-4ed5-9779-55148004e4ef None admin] PATH_INFO: `/v3/projects/93858356141a42039d79d8656712d3c3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:31.165208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d9480-9d84-4ed5-9779-55148004e4ef None admin] RBAC: Authorizing `identity:get_project(project_id=93858356141a42039d79d8656712d3c3)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:31.166671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d9480-9d84-4ed5-9779-55148004e4ef None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:31.168596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 544/1058] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:26:31 2022] GET /identity/v3/projects/93858356141a42039d79d8656712d3c3 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:31.174526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dc28e-ba3d-47fb-ba39-194b052000d5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:31.224893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:31.276735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dc28e-ba3d-47fb-ba39-194b052000d5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:31.314014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56efd8-5788-4f70-9daa-2876b7e5e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:31.315009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56efd8-5788-4f70-9daa-2876b7e5e326 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:31.315475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56efd8-5788-4f70-9daa-2876b7e5e326 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:31.315927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56efd8-5788-4f70-9daa-2876b7e5e326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:31.317029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56efd8-5788-4f70-9daa-2876b7e5e326 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=93858356141a42039d79d8656712d3c3, user.id=433aa93b19b74d08b8b370f87313d6e3) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:31.317564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56efd8-5788-4f70-9daa-2876b7e5e326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:31.319192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56efd8-5788-4f70-9daa-2876b7e5e326 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:31.325161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 515/1059] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:31 2022] GET /identity/v3/role_assignments?user.id=433aa93b19b74d08b8b370f87313d6e3&scope.project.id=93858356141a42039d79d8656712d3c3&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:31.527489 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8200b-f6b0-445e-be4e-d87a87f493c6 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:31.528018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8200b-f6b0-445e-be4e-d87a87f493c6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:31.528018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8200b-f6b0-445e-be4e-d87a87f493c6 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:31.529602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 545/1060] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:31.534812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bbc25-5129-4b8c-9457-78817f55199d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:31.535229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bbc25-5129-4b8c-9457-78817f55199d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:31.535387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54bbc25-5129-4b8c-9457-78817f55199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:31.552892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b54bbc25-5129-4b8c-9457-78817f55199d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:31.554118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b54bbc25-5129-4b8c-9457-78817f55199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:31.627776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 516/1061] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:31.650642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8200b-f6b0-445e-be4e-d87a87f493c6 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:31.653767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:31.726599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f445b-79dc-480b-af54-07694de0a19c None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:31.727257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f445b-79dc-480b-af54-07694de0a19c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:31.727547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f445b-79dc-480b-af54-07694de0a19c None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:31.729126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 517/1062] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:31.734148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a767d-580b-4c60-8a7d-83f38fb7f037 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:31.734835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a767d-580b-4c60-8a7d-83f38fb7f037 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:31.735124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a767d-580b-4c60-8a7d-83f38fb7f037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:31.752966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-359a767d-580b-4c60-8a7d-83f38fb7f037 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:31.754194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-359a767d-580b-4c60-8a7d-83f38fb7f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:31.761464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8200b-f6b0-445e-be4e-d87a87f493c6 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:31.797890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:31.799502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9145-82d9-46d5-84ca-6a55e79856f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:31.800702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9145-82d9-46d5-84ca-6a55e79856f3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:31.801005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9145-82d9-46d5-84ca-6a55e79856f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:31.801281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9145-82d9-46d5-84ca-6a55e79856f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:31.812534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a9145-82d9-46d5-84ca-6a55e79856f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-053a9145-82d9-46d5-84ca-6a55e79856f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:31.820896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:31.822148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:31.823031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 546/1063] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jul 1 19:26:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:31.828570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9145-82d9-46d5-84ca-6a55e79856f3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:31.831311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 518/1064] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:31.855668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a767d-580b-4c60-8a7d-83f38fb7f037 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:31.891430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:31.952662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9145-82d9-46d5-84ca-6a55e79856f3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:31.977300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a767d-580b-4c60-8a7d-83f38fb7f037 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:31.988174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:31.989154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:31.989559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:31.989802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:31.990513 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:31.990929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:31.992318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.001022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 547/1065] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jul 1 19:26:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:32.006683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:32.017380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efab69-12d7-4748-82a7-5c15cf12a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:32.018860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efab69-12d7-4748-82a7-5c15cf12a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:32.019642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efab69-12d7-4748-82a7-5c15cf12a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:32.020420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efab69-12d7-4748-82a7-5c15cf12a9e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:32.079805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:32.106782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efab69-12d7-4748-82a7-5c15cf12a9e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:32.108353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efab69-12d7-4748-82a7-5c15cf12a9e7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.116245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930d5b-00c7-4405-a6a2-2adfb8a5748a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:32.140191 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:32.151877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:32.152677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:32.152960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:32.153234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:32.164187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:32.165684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:32.183739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:32.184767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:32.185662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:32.185662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:32.185662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:32.185662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:32.185662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 548/1066] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:32.190647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:32.214885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 519/1067] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:32.221055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efab69-12d7-4748-82a7-5c15cf12a9e7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:32.297174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd234cf-50d3-4942-978f-6db61cec73d6 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:32.319064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:32.334409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:32.335393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:32.335681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:32.335960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:32.336915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:32.337025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:32.338380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.345781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efab69-12d7-4748-82a7-5c15cf12a9e7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:32.351629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 549/1068] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:32.357166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:32.386404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:32.387202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:32.387483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:32.387862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:32.392729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:32.399643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:32.401130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:32.420296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:32.421292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:32.422208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:32.422208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:32.422208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:32.422208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:32.422208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 520/1069] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:32.427658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:32.464870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514d1f3-fbaa-4de6-800d-b1432710c84b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:32.501086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:32.501870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:32.502188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:32.502466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:32.509700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:32.511177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:32.526570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:32.527508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:26:32.528910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:32.531192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 550/1070] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:26:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:32.535263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b5e73e-4fd8-4094-8dc8-3d957d392851 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:32.536843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:32.563826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:32.573351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:32.573968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:32.574272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:32.574548 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:32.575272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:32.575581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:32.576951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.591534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 521/1071] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:32.642062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:32.648738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd3683-77e7-4546-9647-1fd161c8f5e6 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:32.686384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:32.687066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:32.687351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:32.687629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:32.688485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:32.688801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:32.690277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.711298 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 551/1072] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:26:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:32.717171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:32.827053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62ad84-41c8-4029-a08f-9f083253e9e9 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:32.866013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:32.866986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:32.867358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:32.867679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:32.878592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:32.880103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:32.897785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:32.898967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:32.899880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:32.899880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:32.899880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:32.899880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:32.899880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 522/1073] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:32.904848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:33.007751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba0cf-dcff-4667-b950-5d572792467d None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:33.045385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:33.046202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.046490 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.046766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.047491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:33.048033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:33.049447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:33.062085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 552/1074] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:33.067854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:33.109927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:33.175688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835083f-16b7-4fe7-bae6-82873c6eb3fa None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:33.210845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87af74-552e-4786-bcbd-e47161c79509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:33.211728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87af74-552e-4786-bcbd-e47161c79509 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.212018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87af74-552e-4786-bcbd-e47161c79509 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.212289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87af74-552e-4786-bcbd-e47161c79509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.219256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87af74-552e-4786-bcbd-e47161c79509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:33.220691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87af74-552e-4786-bcbd-e47161c79509 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-1d87af74-552e-4786-bcbd-e47161c79509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:33.235087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:33.236006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:33.236981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 523/1075] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:33.242426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:33.260955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:33.325222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf679a0-fe25-4590-af90-2e95180c0415 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.325489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf679a0-fe25-4590-af90-2e95180c0415 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.325769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf679a0-fe25-4590-af90-2e95180c0415 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.327170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 524/1076] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:26:33.332279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72a7f-9169-452f-a9c7-44af203a2a61 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.332563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72a7f-9169-452f-a9c7-44af203a2a61 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.332836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae72a7f-9169-452f-a9c7-44af203a2a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.349977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8ae72a7f-9169-452f-a9c7-44af203a2a61 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:33.351018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b18f22-171e-4a0a-9a37-c7fcbde00a63 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:33.351158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8ae72a7f-9169-452f-a9c7-44af203a2a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:33.384215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:33.384874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.385160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.385438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.386264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:33.386575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:33.387996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:33.400201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 553/1077] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:33.406210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:33.417805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 525/1078] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:33.440310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae72a7f-9169-452f-a9c7-44af203a2a61 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:33.468530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:33.479834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:33.504606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e692c-5c6a-4199-9061-8d78ed45902b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:33.537658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bf6f0-b0c2-4e82-ab6e-e16aa76487b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:33.538560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf6f0-b0c2-4e82-ab6e-e16aa76487b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.538834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf6f0-b0c2-4e82-ab6e-e16aa76487b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.539103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf6f0-b0c2-4e82-ab6e-e16aa76487b9 None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/d78ccd9541dc48cfbdfc116dcec91a2f/roles/b09f5867b4d8422dbbbbdb67ed9e8743` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.541457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bf6f0-b0c2-4e82-ab6e-e16aa76487b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=d78ccd9541dc48cfbdfc116dcec91a2f, role_id=b09f5867b4d8422dbbbbdb67ed9e8743)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:33.542912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bf6f0-b0c2-4e82-ab6e-e16aa76487b9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:33.543382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae72a7f-9169-452f-a9c7-44af203a2a61 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:33.556838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 554/1079] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:26:33 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/d78ccd9541dc48cfbdfc116dcec91a2f/roles/b09f5867b4d8422dbbbbdb67ed9e8743 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:26:33.581806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f751-770e-4a53-bcf0-2a8d6e89add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:33.582690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f751-770e-4a53-bcf0-2a8d6e89add7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.582976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f751-770e-4a53-bcf0-2a8d6e89add7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.583252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f751-770e-4a53-bcf0-2a8d6e89add7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.597268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9f751-770e-4a53-bcf0-2a8d6e89add7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-73a9f751-770e-4a53-bcf0-2a8d6e89add7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:33.605464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:33.606616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:33.607466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 526/1080] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:33.613462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bf6f0-b0c2-4e82-ab6e-e16aa76487b9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:33.722309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bf6f0-b0c2-4e82-ab6e-e16aa76487b9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:33.755652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:33.756319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.756595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.756869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.757609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:33.757914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:33.759334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:33.760727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:33.770106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 555/1081] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:33.775231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f751-770e-4a53-bcf0-2a8d6e89add7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:33.867378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:33.880299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f751-770e-4a53-bcf0-2a8d6e89add7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:33.914496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e9fd1-beb2-4107-9b52-e31ee59a27bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:33.915506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e9fd1-beb2-4107-9b52-e31ee59a27bc None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:33.915778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e9fd1-beb2-4107-9b52-e31ee59a27bc None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:33.916044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e9fd1-beb2-4107-9b52-e31ee59a27bc None admin] PATH_INFO: `/v3/users/433aa93b19b74d08b8b370f87313d6e3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:33.917273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e9fd1-beb2-4107-9b52-e31ee59a27bc None admin] RBAC: Authorizing `identity:get_user(user_id=433aa93b19b74d08b8b370f87313d6e3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:33.918733 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390e9fd1-beb2-4107-9b52-e31ee59a27bc None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:33.920369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 527/1082] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:33 2022] GET /identity/v3/users/433aa93b19b74d08b8b370f87313d6e3 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:33.926379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:34.026813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd32359-f91e-4429-8675-df3d6ce23152 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:34.065579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8734f4-e27f-4b8d-8057-a96ce1cf2a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:34.066596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8734f4-e27f-4b8d-8057-a96ce1cf2a58 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:34.066884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8734f4-e27f-4b8d-8057-a96ce1cf2a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:34.067183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8734f4-e27f-4b8d-8057-a96ce1cf2a58 None admin] PATH_INFO: `/v3/projects/93858356141a42039d79d8656712d3c3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:34.068368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8734f4-e27f-4b8d-8057-a96ce1cf2a58 None admin] RBAC: Authorizing `identity:get_project(project_id=93858356141a42039d79d8656712d3c3)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:34.069790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8734f4-e27f-4b8d-8057-a96ce1cf2a58 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:34.071672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 556/1083] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:26:33 2022] GET /identity/v3/projects/93858356141a42039d79d8656712d3c3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:34.077639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e9fd1-beb2-4107-9b52-e31ee59a27bc None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:34.178210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e9fd1-beb2-4107-9b52-e31ee59a27bc None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:34.212850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bbd9d-dfe9-4a6e-ba5e-c37f4e64a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:34.213734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bbd9d-dfe9-4a6e-ba5e-c37f4e64a346 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:34.214036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bbd9d-dfe9-4a6e-ba5e-c37f4e64a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:34.214310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bbd9d-dfe9-4a6e-ba5e-c37f4e64a346 None admin] PATH_INFO: `/v3/projects/93858356141a42039d79d8656712d3c3/users/433aa93b19b74d08b8b370f87313d6e3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:34.216346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bbd9d-dfe9-4a6e-ba5e-c37f4e64a346 None admin] RBAC: Authorizing `identity:create_grant(project_id=93858356141a42039d79d8656712d3c3, user_id=433aa93b19b74d08b8b370f87313d6e3, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:34.217769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bbd9d-dfe9-4a6e-ba5e-c37f4e64a346 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:34.232424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 528/1084] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:26:34 2022] PUT /identity/v3/projects/93858356141a42039d79d8656712d3c3/users/433aa93b19b74d08b8b370f87313d6e3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:26:35.552679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176da37-0181-4e7a-a31a-d833546a16c5 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:35.553260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176da37-0181-4e7a-a31a-d833546a16c5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:35.553260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176da37-0181-4e7a-a31a-d833546a16c5 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:35.554888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 557/1085] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:35.560049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4abcea-512a-4a97-aea8-ddc9cf03964c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:35.560476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4abcea-512a-4a97-aea8-ddc9cf03964c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:35.560618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4abcea-512a-4a97-aea8-ddc9cf03964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:35.577402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7d4abcea-512a-4a97-aea8-ddc9cf03964c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:35.578610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7d4abcea-512a-4a97-aea8-ddc9cf03964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:35.590486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:35.647577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 529/1086] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:35.671061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176da37-0181-4e7a-a31a-d833546a16c5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:35.736337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:35.776407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176da37-0181-4e7a-a31a-d833546a16c5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:35.811790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8112-68e3-4d06-a682-82fc510f3165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:35.812551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8112-68e3-4d06-a682-82fc510f3165 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:35.812838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8112-68e3-4d06-a682-82fc510f3165 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:35.813116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe8112-68e3-4d06-a682-82fc510f3165 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:35.823798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe8112-68e3-4d06-a682-82fc510f3165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-5dbe8112-68e3-4d06-a682-82fc510f3165 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:35.832031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:35.832957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:35.833795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 558/1087] 10.222.0.61 () {56 vars in 1120 bytes} [Fri Jul 1 19:26:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:35.839743 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4abcea-512a-4a97-aea8-ddc9cf03964c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:35.943587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4abcea-512a-4a97-aea8-ddc9cf03964c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:35.981490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:35.982166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:35.982441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:35.982716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:35.983466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:35.983766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:35.985146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:35.993207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 530/1088] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jul 1 19:26:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:35.999022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8112-68e3-4d06-a682-82fc510f3165 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.107453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe8112-68e3-4d06-a682-82fc510f3165 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.130808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:36.143106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bc201-a700-4934-b494-31a9ec328f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.143905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bc201-a700-4934-b494-31a9ec328f1d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.144186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bc201-a700-4934-b494-31a9ec328f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.144464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bc201-a700-4934-b494-31a9ec328f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.155401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bc201-a700-4934-b494-31a9ec328f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:36.156845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bc201-a700-4934-b494-31a9ec328f1d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-339bc201-a700-4934-b494-31a9ec328f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:36.174053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:36.174969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:36.175850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:36.175850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:36.175850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:36.175850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:36.175850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 559/1089] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:36.182379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.194540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:36.201014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec41a5-5db4-4437-968a-1746c6383ed0 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.201301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec41a5-5db4-4437-968a-1746c6383ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.201575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec41a5-5db4-4437-968a-1746c6383ed0 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.202982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 560/1090] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:36.207873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b869d6-af05-44ee-a1b5-98813bffe410 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.208125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b869d6-af05-44ee-a1b5-98813bffe410 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.208398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b869d6-af05-44ee-a1b5-98813bffe410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.225696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-81b869d6-af05-44ee-a1b5-98813bffe410 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:36.226915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-81b869d6-af05-44ee-a1b5-98813bffe410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:36.287960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ac460-e9f3-4ec7-966d-e551eeef2f49 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.294110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 561/1091] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:36.317857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b869d6-af05-44ee-a1b5-98813bffe410 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.323307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.323977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.324261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.324539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.325261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:36.325863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:36.327042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:36.344547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 531/1092] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:36.345620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.412792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:36.414764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b869d6-af05-44ee-a1b5-98813bffe410 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.422280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:36.447137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70623682-fc1d-49f9-b640-34c529ea4dc3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.449769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212d79-f765-4e52-85c1-5a0cf276a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.450598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212d79-f765-4e52-85c1-5a0cf276a8dc None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.450885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212d79-f765-4e52-85c1-5a0cf276a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.451161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3212d79-f765-4e52-85c1-5a0cf276a8dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.461648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3212d79-f765-4e52-85c1-5a0cf276a8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-b3212d79-f765-4e52-85c1-5a0cf276a8dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:36.469282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:36.470313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:36.471192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 562/1093] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:36.476432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212d79-f765-4e52-85c1-5a0cf276a8dc None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.481096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.481886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.482191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.482459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.490129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:36.491588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:26:36.507095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:36.508040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:36.508972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 532/1094] 10.222.0.61 () {56 vars in 1093 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:36.513904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.577362 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3212d79-f765-4e52-85c1-5a0cf276a8dc None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.612056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.612726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.613007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.613166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3bc91-8d7c-46e5-bfda-b839b29f0fcf None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.613580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.614051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:36.614355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:36.615765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:36.629089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 563/1095] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:36.630126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.639355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:36.648690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.649551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.649820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.650149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.651003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:36.651311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:36.652737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:36.659313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:36.670547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 533/1096] 10.222.0.61 () {56 vars in 1133 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:36.676219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.741922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d80fc-05f6-4111-9a2d-418e9aeb6938 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.776875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6f42-33c3-41df-80d5-71c284430921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.777984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6f42-33c3-41df-80d5-71c284430921 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.778297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6f42-33c3-41df-80d5-71c284430921 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.778556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6f42-33c3-41df-80d5-71c284430921 None admin] PATH_INFO: `/v3/users/433aa93b19b74d08b8b370f87313d6e3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.779768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6f42-33c3-41df-80d5-71c284430921 None admin] RBAC: Authorizing `identity:get_user(user_id=433aa93b19b74d08b8b370f87313d6e3)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:36.781203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6f42-33c3-41df-80d5-71c284430921 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:36.782892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 564/1097] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/users/433aa93b19b74d08b8b370f87313d6e3 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:36.785388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663c949-6c86-45b0-abaf-4f4d14e7a00e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.789271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6f42-33c3-41df-80d5-71c284430921 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:36.821124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c9bad-3a00-4e86-915e-fbdaa5703e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.821856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c9bad-3a00-4e86-915e-fbdaa5703e49 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.822231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c9bad-3a00-4e86-915e-fbdaa5703e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.822504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c9bad-3a00-4e86-915e-fbdaa5703e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.876707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:36.881352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:36.887874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6f42-33c3-41df-80d5-71c284430921 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:36.890015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c9bad-3a00-4e86-915e-fbdaa5703e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:36.891467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c9bad-3a00-4e86-915e-fbdaa5703e49 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:36.922016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d8212-60fe-43a0-9ece-3adeeed88fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:36.922620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d8212-60fe-43a0-9ece-3adeeed88fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:36.922881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d8212-60fe-43a0-9ece-3adeeed88fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:36.923157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d8212-60fe-43a0-9ece-3adeeed88fb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:36.990535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d8212-60fe-43a0-9ece-3adeeed88fb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:36.991894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 534/1098] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 19:26:36.992000 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d8212-60fe-43a0-9ece-3adeeed88fb2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:36.997701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c9bad-3a00-4e86-915e-fbdaa5703e49 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:37.089795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:37.090588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:37.097397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 565/1099] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:37.103242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d8212-60fe-43a0-9ece-3adeeed88fb2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:37.106147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c9bad-3a00-4e86-915e-fbdaa5703e49 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:37.138998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:37.139785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:37.140066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:37.140338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:37.150484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:37.151945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:26:37.169485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:37.170424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:37.171314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:26:37.171314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:26:37.171314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:26:37.171314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:37.171314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 535/1100] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:37.176476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:37.205096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d8212-60fe-43a0-9ece-3adeeed88fb2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:37.239644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995bbf3-c2d6-4d97-9b9f-5215877d6226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:37.240510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995bbf3-c2d6-4d97-9b9f-5215877d6226 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:37.240793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995bbf3-c2d6-4d97-9b9f-5215877d6226 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:37.241074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995bbf3-c2d6-4d97-9b9f-5215877d6226 None admin] PATH_INFO: `/v3/projects/93858356141a42039d79d8656712d3c3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:37.242393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995bbf3-c2d6-4d97-9b9f-5215877d6226 None admin] RBAC: Authorizing `identity:get_project(project_id=93858356141a42039d79d8656712d3c3)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:37.243933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995bbf3-c2d6-4d97-9b9f-5215877d6226 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:37.245665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 566/1101] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:26:37 2022] GET /identity/v3/projects/93858356141a42039d79d8656712d3c3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:37.251635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995bbf3-c2d6-4d97-9b9f-5215877d6226 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:37.277560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd81ee8-f4d4-4543-9d6c-87e36dbfb021 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:37.312581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:37.312784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:37.313319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:37.313603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:37.313927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:37.314719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:37.315099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:37.316595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:37.323263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:37.328449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 536/1102] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:37.334050 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:37.355169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995bbf3-c2d6-4d97-9b9f-5215877d6226 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:37.393622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:37.394315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:37.394601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:37.394880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:37.395707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=93858356141a42039d79d8656712d3c3, user.id=433aa93b19b74d08b8b370f87313d6e3) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:37.396020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:37.397455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:37.405236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 567/1103] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:37 2022] GET /identity/v3/role_assignments?user.id=433aa93b19b74d08b8b370f87313d6e3&scope.project.id=93858356141a42039d79d8656712d3c3&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:37.441543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9dfd5-df22-455c-a4b7-2e97f477dd2f None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:37.482537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:37.483352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:37.483630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:37.483903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:37.492035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:37.493554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:26:37.509385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:37.510416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:26:37.511698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 537/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:26:37.516887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:37.621847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70390c7e-e3d6-4e0e-a586-fc99e980e670 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:37.646959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:37.655034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257380d-8cd2-4483-a228-4c7a7bb84362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:37.655693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257380d-8cd2-4483-a228-4c7a7bb84362 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:37.655976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257380d-8cd2-4483-a228-4c7a7bb84362 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:37.656247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257380d-8cd2-4483-a228-4c7a7bb84362 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:37.657035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257380d-8cd2-4483-a228-4c7a7bb84362 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:37.657343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257380d-8cd2-4483-a228-4c7a7bb84362 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:37.658803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f257380d-8cd2-4483-a228-4c7a7bb84362 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:37.671009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 568/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:37.677092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:37.737533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:37.781292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101fc18-8889-4fe7-9c3d-bf061c9fc50c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:37.817000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b813b5e-8251-4bc1-bc0f-e4a8980a52e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:37.817625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813b5e-8251-4bc1-bc0f-e4a8980a52e2 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:37.817907 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813b5e-8251-4bc1-bc0f-e4a8980a52e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:37.818220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b813b5e-8251-4bc1-bc0f-e4a8980a52e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:37.819022 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b813b5e-8251-4bc1-bc0f-e4a8980a52e2 None admin] RBAC: Adding query filter params (role.id=b09f5867b4d8422dbbbbdb67ed9e8743, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=d78ccd9541dc48cfbdfc116dcec91a2f) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:37.819325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b813b5e-8251-4bc1-bc0f-e4a8980a52e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:37.820771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b813b5e-8251-4bc1-bc0f-e4a8980a52e2 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:37.826893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 538/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:37 2022] GET /identity/v3/role_assignments?user.id=d78ccd9541dc48cfbdfc116dcec91a2f&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=b09f5867b4d8422dbbbbdb67ed9e8743 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:39.453434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84f3c-8a90-4d57-9f14-39758157957d None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:39.454407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84f3c-8a90-4d57-9f14-39758157957d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:39.454407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84f3c-8a90-4d57-9f14-39758157957d None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:39.456697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 569/1107] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:39.462335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706a51-68b0-428b-82af-1e314c4bb3b2 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:39.462781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706a51-68b0-428b-82af-1e314c4bb3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:39.462895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a706a51-68b0-428b-82af-1e314c4bb3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:39.481446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7a706a51-68b0-428b-82af-1e314c4bb3b2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:39.482649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7a706a51-68b0-428b-82af-1e314c4bb3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:39.554685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 539/1108] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:39.580443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce84f3c-8a90-4d57-9f14-39758157957d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:39.694094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce84f3c-8a90-4d57-9f14-39758157957d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:39.729935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f97b7-d3b2-436c-b046-e03dea772b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:39.730668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f97b7-d3b2-436c-b046-e03dea772b82 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:39.730945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f97b7-d3b2-436c-b046-e03dea772b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:39.731213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f97b7-d3b2-436c-b046-e03dea772b82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:39.732418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f97b7-d3b2-436c-b046-e03dea772b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:39.733840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f97b7-d3b2-436c-b046-e03dea772b82 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:39.735450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 570/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:39.744526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a706a51-68b0-428b-82af-1e314c4bb3b2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:39.808077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:39.859881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a706a51-68b0-428b-82af-1e314c4bb3b2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:39.894961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99494-fdc5-481c-9a9f-5275e39c3250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:39.895622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99494-fdc5-481c-9a9f-5275e39c3250 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:39.895902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99494-fdc5-481c-9a9f-5275e39c3250 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:39.896176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99494-fdc5-481c-9a9f-5275e39c3250 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:39.896890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99494-fdc5-481c-9a9f-5275e39c3250 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:39.898359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99494-fdc5-481c-9a9f-5275e39c3250 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:39.921554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 540/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:26:39 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:41.959381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d2be-0ab0-4ce0-b1b2-34937e47520a None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:41.960621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d2be-0ab0-4ce0-b1b2-34937e47520a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:41.960621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3d2be-0ab0-4ce0-b1b2-34937e47520a None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:41.962842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 571/1111] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:41.968162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50d35-1e35-432f-807e-7aabf4a4ea21 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:41.968593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50d35-1e35-432f-807e-7aabf4a4ea21 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:41.968695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a50d35-1e35-432f-807e-7aabf4a4ea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:41.986827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-71a50d35-1e35-432f-807e-7aabf4a4ea21 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:41.987988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-71a50d35-1e35-432f-807e-7aabf4a4ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:42.062274 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 541/1112] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:26:42.086032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3d2be-0ab0-4ce0-b1b2-34937e47520a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:42.151896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:42.200989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3d2be-0ab0-4ce0-b1b2-34937e47520a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:42.242265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6fc40-3f4a-40a9-adac-098bc24eea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:42.243110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fc40-3f4a-40a9-adac-098bc24eea6f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:42.243349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fc40-3f4a-40a9-adac-098bc24eea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:42.243748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6fc40-3f4a-40a9-adac-098bc24eea6f None admin] PATH_INFO: `/v3/roles/048795d190224624ad8e995082b0faa0` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:42.245272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6fc40-3f4a-40a9-adac-098bc24eea6f None admin] RBAC: Authorizing `identity:get_role(role_id=048795d190224624ad8e995082b0faa0)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:42.246659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6fc40-3f4a-40a9-adac-098bc24eea6f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:42.248039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 572/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:42 2022] GET /identity/v3/roles/048795d190224624ad8e995082b0faa0 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:42.257332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a50d35-1e35-432f-807e-7aabf4a4ea21 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:42.307069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:42.380089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a50d35-1e35-432f-807e-7aabf4a4ea21 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:42.424112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4adb-8982-42e1-ae89-1af1c23842f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:42.425459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4adb-8982-42e1-ae89-1af1c23842f8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:42.425880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4adb-8982-42e1-ae89-1af1c23842f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:42.426386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4adb-8982-42e1-ae89-1af1c23842f8 None admin] PATH_INFO: `/v3/users/54c161eafbe849b6b3367ac8afb9648b` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:42.441240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e4adb-8982-42e1-ae89-1af1c23842f8 None admin] RBAC: Authorizing `identity:get_user(user_id=54c161eafbe849b6b3367ac8afb9648b)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:42.442719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e4adb-8982-42e1-ae89-1af1c23842f8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:42.444392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 542/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:42 2022] GET /identity/v3/users/54c161eafbe849b6b3367ac8afb9648b => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:42.450420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6fc40-3f4a-40a9-adac-098bc24eea6f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:42.553452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6fc40-3f4a-40a9-adac-098bc24eea6f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:42.576831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:42.595782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989499e-19f0-4a25-bf1a-358dd3b01979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:42.596417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989499e-19f0-4a25-bf1a-358dd3b01979 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:42.596698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989499e-19f0-4a25-bf1a-358dd3b01979 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:42.596973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989499e-19f0-4a25-bf1a-358dd3b01979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:42.665365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989499e-19f0-4a25-bf1a-358dd3b01979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:42.666823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989499e-19f0-4a25-bf1a-358dd3b01979 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:42.781345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 573/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:42.790390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4adb-8982-42e1-ae89-1af1c23842f8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:42.894567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:42.904248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4adb-8982-42e1-ae89-1af1c23842f8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:42.944712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9678c-8480-4abd-b68a-0248a183e8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:42.945564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9678c-8480-4abd-b68a-0248a183e8ae None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:42.945846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9678c-8480-4abd-b68a-0248a183e8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:42.946155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9678c-8480-4abd-b68a-0248a183e8ae None admin] PATH_INFO: `/v3/projects/93858356141a42039d79d8656712d3c3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:42.947460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9678c-8480-4abd-b68a-0248a183e8ae None admin] RBAC: Authorizing `identity:get_project(project_id=93858356141a42039d79d8656712d3c3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:42.948891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9678c-8480-4abd-b68a-0248a183e8ae None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:42.950647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 543/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:26:42 2022] GET /identity/v3/projects/93858356141a42039d79d8656712d3c3 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:42.960691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989499e-19f0-4a25-bf1a-358dd3b01979 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:42.989594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:43.091765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989499e-19f0-4a25-bf1a-358dd3b01979 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:43.126436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937209-64fb-4c14-ba88-5049a84304d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:43.127076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937209-64fb-4c14-ba88-5049a84304d1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:43.127353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937209-64fb-4c14-ba88-5049a84304d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:43.127622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937209-64fb-4c14-ba88-5049a84304d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:43.128613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937209-64fb-4c14-ba88-5049a84304d1 None admin] RBAC: Adding query filter params (role.id=048795d190224624ad8e995082b0faa0, scope.project.id=93858356141a42039d79d8656712d3c3, user.id=54c161eafbe849b6b3367ac8afb9648b) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:43.128921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937209-64fb-4c14-ba88-5049a84304d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:43.130371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937209-64fb-4c14-ba88-5049a84304d1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:43.135864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 574/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:42 2022] GET /identity/v3/role_assignments?user.id=54c161eafbe849b6b3367ac8afb9648b&scope.project.id=93858356141a42039d79d8656712d3c3&role.id=048795d190224624ad8e995082b0faa0 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:45.112284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53a608-70a4-447f-8fd2-01eb2602c1f4 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:45.112816 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53a608-70a4-447f-8fd2-01eb2602c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:45.112816 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53a608-70a4-447f-8fd2-01eb2602c1f4 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:45.114251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 544/1118] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:45.120690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607397da-7afa-4a27-af3e-f16c2b1244d3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:45.121446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607397da-7afa-4a27-af3e-f16c2b1244d3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:45.121542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607397da-7afa-4a27-af3e-f16c2b1244d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:45.142891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-607397da-7afa-4a27-af3e-f16c2b1244d3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:45.144085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-607397da-7afa-4a27-af3e-f16c2b1244d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:45.217399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 575/1119] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:45.240638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53a608-70a4-447f-8fd2-01eb2602c1f4 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:45.351846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53a608-70a4-447f-8fd2-01eb2602c1f4 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:45.387346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed664ae-51b4-47a1-ba40-05fcb3a01695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:45.388192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed664ae-51b4-47a1-ba40-05fcb3a01695 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:45.388470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed664ae-51b4-47a1-ba40-05fcb3a01695 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:45.388744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed664ae-51b4-47a1-ba40-05fcb3a01695 None admin] PATH_INFO: `/v3/roles/048795d190224624ad8e995082b0faa0` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:45.390294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed664ae-51b4-47a1-ba40-05fcb3a01695 None admin] RBAC: Authorizing `identity:get_role(role_id=048795d190224624ad8e995082b0faa0)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:45.391675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed664ae-51b4-47a1-ba40-05fcb3a01695 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:45.393050 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 545/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:45 2022] GET /identity/v3/roles/048795d190224624ad8e995082b0faa0 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:45.399251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607397da-7afa-4a27-af3e-f16c2b1244d3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:45.418798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:45.501609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607397da-7afa-4a27-af3e-f16c2b1244d3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:45.544249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeee83-ec74-458c-ba9d-74e7ba40f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:45.545113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeee83-ec74-458c-ba9d-74e7ba40f7cd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:45.545395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeee83-ec74-458c-ba9d-74e7ba40f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:45.545674 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeee83-ec74-458c-ba9d-74e7ba40f7cd None admin] PATH_INFO: `/v3/users/54c161eafbe849b6b3367ac8afb9648b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:45.547014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebeee83-ec74-458c-ba9d-74e7ba40f7cd None admin] RBAC: Authorizing `identity:get_user(user_id=54c161eafbe849b6b3367ac8afb9648b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:45.548469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebeee83-ec74-458c-ba9d-74e7ba40f7cd None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:45.550234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 576/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:45 2022] GET /identity/v3/users/54c161eafbe849b6b3367ac8afb9648b => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:45.556340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed664ae-51b4-47a1-ba40-05fcb3a01695 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:45.590005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:45.659441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed664ae-51b4-47a1-ba40-05fcb3a01695 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:45.699988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c169d3f-f3a6-4f6b-8c7b-a8d13e9aa08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:45.700868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169d3f-f3a6-4f6b-8c7b-a8d13e9aa08e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:45.701129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169d3f-f3a6-4f6b-8c7b-a8d13e9aa08e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:45.701398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169d3f-f3a6-4f6b-8c7b-a8d13e9aa08e None admin] PATH_INFO: `/v3/projects/93858356141a42039d79d8656712d3c3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:45.702702 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c169d3f-f3a6-4f6b-8c7b-a8d13e9aa08e None admin] RBAC: Authorizing `identity:get_project(project_id=93858356141a42039d79d8656712d3c3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:45.704137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c169d3f-f3a6-4f6b-8c7b-a8d13e9aa08e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:45.705833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 546/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:26:45 2022] GET /identity/v3/projects/93858356141a42039d79d8656712d3c3 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:45.713113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeee83-ec74-458c-ba9d-74e7ba40f7cd None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:45.807141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:45.825265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeee83-ec74-458c-ba9d-74e7ba40f7cd None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:45.860054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9353a-f3c8-4b89-86c7-608a18b14b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:45.860937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9353a-f3c8-4b89-86c7-608a18b14b4c None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:45.861220 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9353a-f3c8-4b89-86c7-608a18b14b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:45.861495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9353a-f3c8-4b89-86c7-608a18b14b4c None admin] PATH_INFO: `/v3/projects/93858356141a42039d79d8656712d3c3/users/54c161eafbe849b6b3367ac8afb9648b/roles/048795d190224624ad8e995082b0faa0` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:45.864021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9353a-f3c8-4b89-86c7-608a18b14b4c None admin] RBAC: Authorizing `identity:create_grant(project_id=93858356141a42039d79d8656712d3c3, user_id=54c161eafbe849b6b3367ac8afb9648b, role_id=048795d190224624ad8e995082b0faa0)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:45.865439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9353a-f3c8-4b89-86c7-608a18b14b4c None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:45.880847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 577/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:26:45 2022] PUT /identity/v3/projects/93858356141a42039d79d8656712d3c3/users/54c161eafbe849b6b3367ac8afb9648b/roles/048795d190224624ad8e995082b0faa0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:26:47.863413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879549f-81eb-457c-a2fa-40f36e33083a None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:47.864251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879549f-81eb-457c-a2fa-40f36e33083a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:47.864251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879549f-81eb-457c-a2fa-40f36e33083a None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:47.866484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 547/1124] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:47.871894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ead7-92de-4555-8f60-0f2db95b4260 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:47.872341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ead7-92de-4555-8f60-0f2db95b4260 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:47.872443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ead7-92de-4555-8f60-0f2db95b4260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:47.890456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-67e5ead7-92de-4555-8f60-0f2db95b4260 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:47.891640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-67e5ead7-92de-4555-8f60-0f2db95b4260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:47.962677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 578/1125] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:47.986280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879549f-81eb-457c-a2fa-40f36e33083a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:48.090265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:48.095691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879549f-81eb-457c-a2fa-40f36e33083a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:48.143337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfd9b7-8bbc-479e-8b5a-fa94038ee8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:48.144199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfd9b7-8bbc-479e-8b5a-fa94038ee8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:48.144487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfd9b7-8bbc-479e-8b5a-fa94038ee8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:48.144763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfd9b7-8bbc-479e-8b5a-fa94038ee8d8 None admin] PATH_INFO: `/v3/roles/048795d190224624ad8e995082b0faa0` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:48.146393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfd9b7-8bbc-479e-8b5a-fa94038ee8d8 None admin] RBAC: Authorizing `identity:get_role(role_id=048795d190224624ad8e995082b0faa0)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:48.147777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfd9b7-8bbc-479e-8b5a-fa94038ee8d8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:48.149172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 548/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:47 2022] GET /identity/v3/roles/048795d190224624ad8e995082b0faa0 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:48.158701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ead7-92de-4555-8f60-0f2db95b4260 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:48.248129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:48.273612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ead7-92de-4555-8f60-0f2db95b4260 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:48.311723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787620d-97c2-4918-af8d-ba39b24862d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:48.313103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787620d-97c2-4918-af8d-ba39b24862d4 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:48.313532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787620d-97c2-4918-af8d-ba39b24862d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:48.313978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787620d-97c2-4918-af8d-ba39b24862d4 None admin] PATH_INFO: `/v3/users/54c161eafbe849b6b3367ac8afb9648b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:48.316238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787620d-97c2-4918-af8d-ba39b24862d4 None admin] RBAC: Authorizing `identity:get_user(user_id=54c161eafbe849b6b3367ac8afb9648b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:48.318676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787620d-97c2-4918-af8d-ba39b24862d4 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:48.321465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 579/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:48 2022] GET /identity/v3/users/54c161eafbe849b6b3367ac8afb9648b => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:48.331333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfd9b7-8bbc-479e-8b5a-fa94038ee8d8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:48.437639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfd9b7-8bbc-479e-8b5a-fa94038ee8d8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:48.472760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e5d5-651c-48c6-8fd3-2c607b8d7be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:48.473388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e5d5-651c-48c6-8fd3-2c607b8d7be6 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:48.473665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e5d5-651c-48c6-8fd3-2c607b8d7be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:48.473940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938e5d5-651c-48c6-8fd3-2c607b8d7be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:48.508837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:48.542253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938e5d5-651c-48c6-8fd3-2c607b8d7be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:48.543695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938e5d5-651c-48c6-8fd3-2c607b8d7be6 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:48.657245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 549/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:48.663610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787620d-97c2-4918-af8d-ba39b24862d4 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:48.768947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787620d-97c2-4918-af8d-ba39b24862d4 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:48.805453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e95f2-d112-4d42-b006-9f7f577fc170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:48.806324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e95f2-d112-4d42-b006-9f7f577fc170 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:48.806602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e95f2-d112-4d42-b006-9f7f577fc170 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:48.806877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e95f2-d112-4d42-b006-9f7f577fc170 None admin] PATH_INFO: `/v3/projects/93858356141a42039d79d8656712d3c3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:48.808145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e95f2-d112-4d42-b006-9f7f577fc170 None admin] RBAC: Authorizing `identity:get_project(project_id=93858356141a42039d79d8656712d3c3)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:48.809573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e95f2-d112-4d42-b006-9f7f577fc170 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:48.811307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 580/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:26:48 2022] GET /identity/v3/projects/93858356141a42039d79d8656712d3c3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:48.818258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e5d5-651c-48c6-8fd3-2c607b8d7be6 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:48.886535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:48.920449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938e5d5-651c-48c6-8fd3-2c607b8d7be6 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:48.954955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd6139-303a-423d-a2ef-1f7937f3f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:48.955592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd6139-303a-423d-a2ef-1f7937f3f21f None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:48.955863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd6139-303a-423d-a2ef-1f7937f3f21f None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:48.956133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd6139-303a-423d-a2ef-1f7937f3f21f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:48.956951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd6139-303a-423d-a2ef-1f7937f3f21f None admin] RBAC: Adding query filter params (role.id=048795d190224624ad8e995082b0faa0, scope.project.id=93858356141a42039d79d8656712d3c3, user.id=54c161eafbe849b6b3367ac8afb9648b) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:48.957263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd6139-303a-423d-a2ef-1f7937f3f21f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:48.958706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd6139-303a-423d-a2ef-1f7937f3f21f None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:48.964959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 550/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:48 2022] GET /identity/v3/role_assignments?user.id=54c161eafbe849b6b3367ac8afb9648b&scope.project.id=93858356141a42039d79d8656712d3c3&role.id=048795d190224624ad8e995082b0faa0 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:51.001505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca860a-95b4-442c-82df-ef2ee764836b None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:51.002514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca860a-95b4-442c-82df-ef2ee764836b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:51.002514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca860a-95b4-442c-82df-ef2ee764836b None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:51.005176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 581/1131] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:51.011652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7811c9-e0fe-493e-88d4-9c3ff5b38d51 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:51.012098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7811c9-e0fe-493e-88d4-9c3ff5b38d51 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:51.012223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7811c9-e0fe-493e-88d4-9c3ff5b38d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:51.040683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ba7811c9-e0fe-493e-88d4-9c3ff5b38d51 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:51.041872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ba7811c9-e0fe-493e-88d4-9c3ff5b38d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:51.112052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 551/1132] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:51.136846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca860a-95b4-442c-82df-ef2ee764836b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:51.162955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:51.263706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca860a-95b4-442c-82df-ef2ee764836b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:51.298976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a00605-c6d3-41dc-a8c5-9901e2fc10ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:51.299756 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a00605-c6d3-41dc-a8c5-9901e2fc10ce None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:51.300038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a00605-c6d3-41dc-a8c5-9901e2fc10ce None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:51.300289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a00605-c6d3-41dc-a8c5-9901e2fc10ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:51.301596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a00605-c6d3-41dc-a8c5-9901e2fc10ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:51.303062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a00605-c6d3-41dc-a8c5-9901e2fc10ce None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:51.304675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 582/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:51.314721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7811c9-e0fe-493e-88d4-9c3ff5b38d51 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:51.384431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:51.426892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7811c9-e0fe-493e-88d4-9c3ff5b38d51 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:51.460823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd059c-c359-4ed1-ab92-8ac1674aba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:51.461507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd059c-c359-4ed1-ab92-8ac1674aba72 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:51.461780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd059c-c359-4ed1-ab92-8ac1674aba72 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:51.462111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd059c-c359-4ed1-ab92-8ac1674aba72 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:51.462817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd059c-c359-4ed1-ab92-8ac1674aba72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:51.464239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd059c-c359-4ed1-ab92-8ac1674aba72 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:51.496211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 552/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:26:51 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:53.550839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502164ef-10f5-467c-aaaf-f1349024815b None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:53.551451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502164ef-10f5-467c-aaaf-f1349024815b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:53.551451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502164ef-10f5-467c-aaaf-f1349024815b None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:53.552810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 583/1135] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:53.559450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b2a2-c3ff-4ab8-9174-56fa9a26393a None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:53.560135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b2a2-c3ff-4ab8-9174-56fa9a26393a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:53.560302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6b2a2-c3ff-4ab8-9174-56fa9a26393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:53.588856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-acc6b2a2-c3ff-4ab8-9174-56fa9a26393a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:53.590073 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-acc6b2a2-c3ff-4ab8-9174-56fa9a26393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:53.661521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 553/1136] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:53.694063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502164ef-10f5-467c-aaaf-f1349024815b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:53.780525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:53.802057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502164ef-10f5-467c-aaaf-f1349024815b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:53.847663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c1a5b-f9f9-42bc-9212-77d0cb0c1d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:53.848777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c1a5b-f9f9-42bc-9212-77d0cb0c1d47 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:53.849161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c1a5b-f9f9-42bc-9212-77d0cb0c1d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:53.849539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c1a5b-f9f9-42bc-9212-77d0cb0c1d47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:53.851498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c1a5b-f9f9-42bc-9212-77d0cb0c1d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:53.853273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c1a5b-f9f9-42bc-9212-77d0cb0c1d47 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:53.854936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 584/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:26:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:53.861134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6b2a2-c3ff-4ab8-9174-56fa9a26393a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:53.911276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:53.969796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6b2a2-c3ff-4ab8-9174-56fa9a26393a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:54.007310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98947f8-3566-4b57-906c-85d73d85d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:54.007967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98947f8-3566-4b57-906c-85d73d85d062 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:54.008326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98947f8-3566-4b57-906c-85d73d85d062 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:54.008604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98947f8-3566-4b57-906c-85d73d85d062 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:54.009318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98947f8-3566-4b57-906c-85d73d85d062 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:54.010773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98947f8-3566-4b57-906c-85d73d85d062 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:54.032595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 554/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:26:53 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:26:56.072049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77224-5e63-4c60-8df8-d9e7c8e0adbc None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:56.072507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77224-5e63-4c60-8df8-d9e7c8e0adbc None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:56.072598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77224-5e63-4c60-8df8-d9e7c8e0adbc None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:56.073980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 585/1139] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:56.079450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849dc02-5fca-4993-9ee6-d43c7de88c0e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:56.079899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849dc02-5fca-4993-9ee6-d43c7de88c0e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:56.080000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849dc02-5fca-4993-9ee6-d43c7de88c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:56.098829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c849dc02-5fca-4993-9ee6-d43c7de88c0e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:56.100038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c849dc02-5fca-4993-9ee6-d43c7de88c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:56.172096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 555/1140] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:56.205588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77224-5e63-4c60-8df8-d9e7c8e0adbc None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:56.324309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77224-5e63-4c60-8df8-d9e7c8e0adbc None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:56.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bb212-92e6-46b1-b9e0-cf427179a2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:56.372390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb212-92e6-46b1-b9e0-cf427179a2cd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:56.372666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb212-92e6-46b1-b9e0-cf427179a2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:56.372930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb212-92e6-46b1-b9e0-cf427179a2cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:56.384284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bb212-92e6-46b1-b9e0-cf427179a2cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-9f1bb212-92e6-46b1-b9e0-cf427179a2cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:56.391839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:56.392967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:56.394244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 586/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:56.401399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849dc02-5fca-4993-9ee6-d43c7de88c0e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:56.432797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:56.505797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849dc02-5fca-4993-9ee6-d43c7de88c0e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:56.544256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:56.544916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:56.545198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:56.545471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:56.546279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:56.546610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:56.547993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:56.556330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 556/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:56.562829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bb212-92e6-46b1-b9e0-cf427179a2cd None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:56.580338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:56.677249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bb212-92e6-46b1-b9e0-cf427179a2cd None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:56.712575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336aaf76-6b7e-4ef6-95c4-379f866f88c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:56.713597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aaf76-6b7e-4ef6-95c4-379f866f88c3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:56.713883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aaf76-6b7e-4ef6-95c4-379f866f88c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:56.714197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aaf76-6b7e-4ef6-95c4-379f866f88c3 None admin] PATH_INFO: `/v3/users/201c70ba36e842178a0c63e23033b444` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:56.735856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336aaf76-6b7e-4ef6-95c4-379f866f88c3 None admin] RBAC: Authorizing `identity:get_user(user_id=201c70ba36e842178a0c63e23033b444)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:56.738172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336aaf76-6b7e-4ef6-95c4-379f866f88c3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:56.740808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 587/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:56 2022] GET /identity/v3/users/201c70ba36e842178a0c63e23033b444 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:26:56.747542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:56.853898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:56.864290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc290077-f2b7-4fd7-b961-9cbab7a829aa None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:56.901307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2621bf8-2de0-4c4e-ade3-1774fd27298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:56.901939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621bf8-2de0-4c4e-ade3-1774fd27298e None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:56.902245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621bf8-2de0-4c4e-ade3-1774fd27298e None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:56.902519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2621bf8-2de0-4c4e-ade3-1774fd27298e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:56.968179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2621bf8-2de0-4c4e-ade3-1774fd27298e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:56.969608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2621bf8-2de0-4c4e-ade3-1774fd27298e None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:57.059848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:57.069747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 557/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:26:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:26:57.076021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336aaf76-6b7e-4ef6-95c4-379f866f88c3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:57.151284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:57.192236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336aaf76-6b7e-4ef6-95c4-379f866f88c3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:57.227560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaed9b0-cce9-4666-8839-6a220d89a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:57.228412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaed9b0-cce9-4666-8839-6a220d89a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:57.228686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaed9b0-cce9-4666-8839-6a220d89a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:57.228953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaed9b0-cce9-4666-8839-6a220d89a0a9 None admin] PATH_INFO: `/v3/projects/530aaf6933024c40b96b60868067c7ba` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:57.230282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaed9b0-cce9-4666-8839-6a220d89a0a9 None admin] RBAC: Authorizing `identity:get_project(project_id=530aaf6933024c40b96b60868067c7ba)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:57.231713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaed9b0-cce9-4666-8839-6a220d89a0a9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:57.233453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 588/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:26:57 2022] GET /identity/v3/projects/530aaf6933024c40b96b60868067c7ba => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:57.242915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2621bf8-2de0-4c4e-ade3-1774fd27298e None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:57.342936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2621bf8-2de0-4c4e-ade3-1774fd27298e None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:57.380221 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cc8ae-f7a3-40ad-b58c-45901cc61858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:57.380856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc8ae-f7a3-40ad-b58c-45901cc61858 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:57.381137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc8ae-f7a3-40ad-b58c-45901cc61858 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:57.381393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cc8ae-f7a3-40ad-b58c-45901cc61858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:57.382421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cc8ae-f7a3-40ad-b58c-45901cc61858 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=530aaf6933024c40b96b60868067c7ba, user.id=201c70ba36e842178a0c63e23033b444) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:57.382732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cc8ae-f7a3-40ad-b58c-45901cc61858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:57.384164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cc8ae-f7a3-40ad-b58c-45901cc61858 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:57.389712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 558/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:26:57 2022] GET /identity/v3/role_assignments?user.id=201c70ba36e842178a0c63e23033b444&scope.project.id=530aaf6933024c40b96b60868067c7ba&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:59.399680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231768-e005-449d-afb4-1717fdb29aec None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:59.400547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231768-e005-449d-afb4-1717fdb29aec None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:59.400547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231768-e005-449d-afb4-1717fdb29aec None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:59.402873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 589/1147] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:26:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:26:59.409187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9354f77-ac61-4063-b2ff-9484fb4a2e60 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:59.409606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9354f77-ac61-4063-b2ff-9484fb4a2e60 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:59.409820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9354f77-ac61-4063-b2ff-9484fb4a2e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:59.431383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f9354f77-ac61-4063-b2ff-9484fb4a2e60 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:26:59.432559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f9354f77-ac61-4063-b2ff-9484fb4a2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:26:59.488211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:59.510477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 559/1148] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:26:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:26:59.533753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231768-e005-449d-afb4-1717fdb29aec None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:59.652664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231768-e005-449d-afb4-1717fdb29aec None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:59.691080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce08848-1ebe-49fb-ac06-653dbc2f5cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:59.691844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce08848-1ebe-49fb-ac06-653dbc2f5cef None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:59.692127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce08848-1ebe-49fb-ac06-653dbc2f5cef None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:59.692397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce08848-1ebe-49fb-ac06-653dbc2f5cef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:59.694562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:26:59.705240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce08848-1ebe-49fb-ac06-653dbc2f5cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-0ce08848-1ebe-49fb-ac06-653dbc2f5cef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:26:59.713323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:26:59.714455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:26:59.715340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 590/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:26:59.722903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9354f77-ac61-4063-b2ff-9484fb4a2e60 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:26:59.831818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9354f77-ac61-4063-b2ff-9484fb4a2e60 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:26:59.875804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:26:59.876460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:26:59.876741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:26:59.877019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:26:59.877771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:26:59.878116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:26:59.879490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:26:59.887888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 560/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:26:59.896336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce08848-1ebe-49fb-ac06-653dbc2f5cef None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:00.000437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce08848-1ebe-49fb-ac06-653dbc2f5cef None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:00.037121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327b8ad-4526-4fbc-bac9-ec22e376ee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:00.037121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b8ad-4526-4fbc-bac9-ec22e376ee77 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:00.037121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b8ad-4526-4fbc-bac9-ec22e376ee77 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:00.037121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b8ad-4526-4fbc-bac9-ec22e376ee77 None admin] PATH_INFO: `/v3/users/201c70ba36e842178a0c63e23033b444` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:00.038393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327b8ad-4526-4fbc-bac9-ec22e376ee77 None admin] RBAC: Authorizing `identity:get_user(user_id=201c70ba36e842178a0c63e23033b444)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:00.039903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327b8ad-4526-4fbc-bac9-ec22e376ee77 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:00.041562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 591/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:26:59 2022] GET /identity/v3/users/201c70ba36e842178a0c63e23033b444 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:00.049124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:00.113123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:00.174789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fa1ce-42e8-42f0-993f-182d69c4b7da None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:00.213202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78576f-a577-4cdb-9d88-98c32d7d9f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:00.214240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78576f-a577-4cdb-9d88-98c32d7d9f2d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:00.214697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78576f-a577-4cdb-9d88-98c32d7d9f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:00.215201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78576f-a577-4cdb-9d88-98c32d7d9f2d None admin] PATH_INFO: `/v3/projects/530aaf6933024c40b96b60868067c7ba` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:00.217078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78576f-a577-4cdb-9d88-98c32d7d9f2d None admin] RBAC: Authorizing `identity:get_project(project_id=530aaf6933024c40b96b60868067c7ba)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:00.219459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78576f-a577-4cdb-9d88-98c32d7d9f2d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:00.221871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 561/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:27:00 2022] GET /identity/v3/projects/530aaf6933024c40b96b60868067c7ba => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:00.231035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327b8ad-4526-4fbc-bac9-ec22e376ee77 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:00.300064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:00.343308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327b8ad-4526-4fbc-bac9-ec22e376ee77 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:00.381907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1f15a-c264-4269-a875-5194e914d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:00.382832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f15a-c264-4269-a875-5194e914d545 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:00.383152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f15a-c264-4269-a875-5194e914d545 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:00.383431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f15a-c264-4269-a875-5194e914d545 None admin] PATH_INFO: `/v3/projects/530aaf6933024c40b96b60868067c7ba/users/201c70ba36e842178a0c63e23033b444/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:00.385417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1f15a-c264-4269-a875-5194e914d545 None admin] RBAC: Authorizing `identity:create_grant(project_id=530aaf6933024c40b96b60868067c7ba, user_id=201c70ba36e842178a0c63e23033b444, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:00.386890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1f15a-c264-4269-a875-5194e914d545 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:00.403433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 592/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:27:00 2022] PUT /identity/v3/projects/530aaf6933024c40b96b60868067c7ba/users/201c70ba36e842178a0c63e23033b444/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:27:02.422475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f340-7a6e-458f-b969-09ff7d324a10 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:02.423314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f340-7a6e-458f-b969-09ff7d324a10 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:02.423314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f340-7a6e-458f-b969-09ff7d324a10 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:02.425203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 562/1154] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:27:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:02.431565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4839-f50d-4e57-a02e-5c48688a7748 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:02.432023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4839-f50d-4e57-a02e-5c48688a7748 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:02.432114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4839-f50d-4e57-a02e-5c48688a7748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:02.451371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-197e4839-f50d-4e57-a02e-5c48688a7748 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:02.452596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-197e4839-f50d-4e57-a02e-5c48688a7748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:02.539433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 593/1155] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:27:02.574478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f340-7a6e-458f-b969-09ff7d324a10 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:02.707315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f340-7a6e-458f-b969-09ff7d324a10 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:02.725794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:02.748122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3339e6-5f74-4b1e-aacb-490474a45261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:02.748917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3339e6-5f74-4b1e-aacb-490474a45261 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:02.749199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3339e6-5f74-4b1e-aacb-490474a45261 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:02.749473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3339e6-5f74-4b1e-aacb-490474a45261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:02.762052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3339e6-5f74-4b1e-aacb-490474a45261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ec3339e6-5f74-4b1e-aacb-490474a45261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:27:02.769675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:27:02.770750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:27:02.771912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 563/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:27:02.778007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4839-f50d-4e57-a02e-5c48688a7748 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:02.845149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:02.898450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4839-f50d-4e57-a02e-5c48688a7748 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:02.949292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:02.950237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:02.950564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:02.950938 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:02.952054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:27:02.952363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:02.954285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:02.966548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 594/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:02.975881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3339e6-5f74-4b1e-aacb-490474a45261 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:03.096190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3339e6-5f74-4b1e-aacb-490474a45261 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:03.140112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259495e3-bd5e-4901-b33f-24f0fce38434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:03.141140 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259495e3-bd5e-4901-b33f-24f0fce38434 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:03.141416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259495e3-bd5e-4901-b33f-24f0fce38434 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:03.141692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259495e3-bd5e-4901-b33f-24f0fce38434 None admin] PATH_INFO: `/v3/users/201c70ba36e842178a0c63e23033b444` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:03.143005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259495e3-bd5e-4901-b33f-24f0fce38434 None admin] RBAC: Authorizing `identity:get_user(user_id=201c70ba36e842178a0c63e23033b444)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:03.145065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259495e3-bd5e-4901-b33f-24f0fce38434 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:03.148233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 564/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:27:02 2022] GET /identity/v3/users/201c70ba36e842178a0c63e23033b444 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:03.157913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:03.279722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf6a01-4d34-43c0-8c23-6e62c12fa18e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:03.295515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:03.318152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fd02a-479c-4d11-a7eb-990cfbd33ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:03.318789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd02a-479c-4d11-a7eb-990cfbd33ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:03.319064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd02a-479c-4d11-a7eb-990cfbd33ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:03.319336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022fd02a-479c-4d11-a7eb-990cfbd33ae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:03.396977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fd02a-479c-4d11-a7eb-990cfbd33ae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:03.398444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022fd02a-479c-4d11-a7eb-990cfbd33ae9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:03.504087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 595/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:27:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:27:03.511256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259495e3-bd5e-4901-b33f-24f0fce38434 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:03.559785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:03.618167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259495e3-bd5e-4901-b33f-24f0fce38434 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:03.653518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c9fa8-f456-4d60-aa54-dfc7d4595cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:03.654404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9fa8-f456-4d60-aa54-dfc7d4595cfa None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:03.654683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9fa8-f456-4d60-aa54-dfc7d4595cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:03.654953 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c9fa8-f456-4d60-aa54-dfc7d4595cfa None admin] PATH_INFO: `/v3/projects/530aaf6933024c40b96b60868067c7ba` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:03.656244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9fa8-f456-4d60-aa54-dfc7d4595cfa None admin] RBAC: Authorizing `identity:get_project(project_id=530aaf6933024c40b96b60868067c7ba)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:03.657675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c9fa8-f456-4d60-aa54-dfc7d4595cfa None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:03.659419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 565/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:27:03 2022] GET /identity/v3/projects/530aaf6933024c40b96b60868067c7ba => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:03.665670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fd02a-479c-4d11-a7eb-990cfbd33ae9 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:03.681529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:03.791458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022fd02a-479c-4d11-a7eb-990cfbd33ae9 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:03.833235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923cb5-c6b5-4f80-9302-a00722c50f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:03.834116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923cb5-c6b5-4f80-9302-a00722c50f1e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:03.834347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923cb5-c6b5-4f80-9302-a00722c50f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:03.835068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923cb5-c6b5-4f80-9302-a00722c50f1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:03.836334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923cb5-c6b5-4f80-9302-a00722c50f1e None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=530aaf6933024c40b96b60868067c7ba, user.id=201c70ba36e842178a0c63e23033b444) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:27:03.836750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923cb5-c6b5-4f80-9302-a00722c50f1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:03.839009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923cb5-c6b5-4f80-9302-a00722c50f1e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:03.848740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 596/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:27:03 2022] GET /identity/v3/role_assignments?user.id=201c70ba36e842178a0c63e23033b444&scope.project.id=530aaf6933024c40b96b60868067c7ba&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:05.888352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0152f-9003-4d3d-ae15-5252ef68e8bd None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:05.889233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0152f-9003-4d3d-ae15-5252ef68e8bd None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:05.889233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0152f-9003-4d3d-ae15-5252ef68e8bd None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:05.891464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 566/1162] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:27:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:05.897704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9c4b-7fb4-4bd4-aa98-f1c79c56be7f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:05.898431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9c4b-7fb4-4bd4-aa98-f1c79c56be7f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:05.898662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d9c4b-7fb4-4bd4-aa98-f1c79c56be7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:05.921653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-022d9c4b-7fb4-4bd4-aa98-f1c79c56be7f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:05.922904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-022d9c4b-7fb4-4bd4-aa98-f1c79c56be7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:05.992515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 597/1163] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:27:06.022170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0152f-9003-4d3d-ae15-5252ef68e8bd None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:06.138672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0152f-9003-4d3d-ae15-5252ef68e8bd None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:06.153163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:06.180762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb5c6b-aa57-464d-842f-0fc40a4cd4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:06.181407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5c6b-aa57-464d-842f-0fc40a4cd4be None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:06.181687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5c6b-aa57-464d-842f-0fc40a4cd4be None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:06.181982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb5c6b-aa57-464d-842f-0fc40a4cd4be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:06.250541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb5c6b-aa57-464d-842f-0fc40a4cd4be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:06.251993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb5c6b-aa57-464d-842f-0fc40a4cd4be None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:06.369422 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 567/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:27:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:27:06.378441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9c4b-7fb4-4bd4-aa98-f1c79c56be7f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:06.389875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:06.487782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d9c4b-7fb4-4bd4-aa98-f1c79c56be7f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:06.523586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee6355-6f39-43a4-9fd1-8ea3c1f4f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:06.524381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6355-6f39-43a4-9fd1-8ea3c1f4f121 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:06.524657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6355-6f39-43a4-9fd1-8ea3c1f4f121 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:06.524929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee6355-6f39-43a4-9fd1-8ea3c1f4f121 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:06.531783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee6355-6f39-43a4-9fd1-8ea3c1f4f121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:06.533215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee6355-6f39-43a4-9fd1-8ea3c1f4f121 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-4fee6355-6f39-43a4-9fd1-8ea3c1f4f121 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:27:06.547810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:27:06.548966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:27:06.549881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 598/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:27:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:27:06.556880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb5c6b-aa57-464d-842f-0fc40a4cd4be None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:06.572476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:06.661577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb5c6b-aa57-464d-842f-0fc40a4cd4be None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:06.696597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5d9e-2eb4-40a1-9306-4cbe48fd3ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:06.697234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5d9e-2eb4-40a1-9306-4cbe48fd3ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:06.697508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5d9e-2eb4-40a1-9306-4cbe48fd3ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:06.697779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5d9e-2eb4-40a1-9306-4cbe48fd3ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:06.698524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5d9e-2eb4-40a1-9306-4cbe48fd3ca3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:27:06.698833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5d9e-2eb4-40a1-9306-4cbe48fd3ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:06.700197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5d9e-2eb4-40a1-9306-4cbe48fd3ca3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:06.707437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 568/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Fri Jul 1 19:27:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:27:08.689870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f094-78ad-4a6a-be5d-6bc6d20fc185 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:08.690501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f094-78ad-4a6a-be5d-6bc6d20fc185 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:08.690501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f094-78ad-4a6a-be5d-6bc6d20fc185 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:08.691817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 599/1167] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:08.697918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c715b-5ca8-4bba-b720-e1ee0b2844f7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:08.698663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c715b-5ca8-4bba-b720-e1ee0b2844f7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:08.698797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c715b-5ca8-4bba-b720-e1ee0b2844f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:08.721028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-129c715b-5ca8-4bba-b720-e1ee0b2844f7 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:08.722241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-129c715b-5ca8-4bba-b720-e1ee0b2844f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:08.793270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 569/1168] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:27:08.816208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f094-78ad-4a6a-be5d-6bc6d20fc185 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:08.886886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:08.924018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f094-78ad-4a6a-be5d-6bc6d20fc185 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:08.960610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9caccf1-8976-4500-ad4a-55918031bbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:08.961315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caccf1-8976-4500-ad4a-55918031bbf9 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:08.961590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caccf1-8976-4500-ad4a-55918031bbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:08.961861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9caccf1-8976-4500-ad4a-55918031bbf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:08.962632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caccf1-8976-4500-ad4a-55918031bbf9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:08.964017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9caccf1-8976-4500-ad4a-55918031bbf9 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:08.982761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 600/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Fri Jul 1 19:27:08 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:27:11.044510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844337f0-c181-4f8a-a8a5-96d8337da8f3 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:11.045356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844337f0-c181-4f8a-a8a5-96d8337da8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:11.045356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844337f0-c181-4f8a-a8a5-96d8337da8f3 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:11.047564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 570/1170] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:27:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:11.055464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fe39f-9631-4ea5-a5db-6083e60fc576 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:11.056005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fe39f-9631-4ea5-a5db-6083e60fc576 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:11.056117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fe39f-9631-4ea5-a5db-6083e60fc576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:11.077926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-137fe39f-9631-4ea5-a5db-6083e60fc576 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:11.079196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-137fe39f-9631-4ea5-a5db-6083e60fc576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:11.148812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 601/1171] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:27:11.173383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844337f0-c181-4f8a-a8a5-96d8337da8f3 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:11.187681 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:11.284825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844337f0-c181-4f8a-a8a5-96d8337da8f3 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:11.319834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9e702-7eea-474e-8c13-e78274390e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:11.320725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e702-7eea-474e-8c13-e78274390e9a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:11.320999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e702-7eea-474e-8c13-e78274390e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:11.321293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e702-7eea-474e-8c13-e78274390e9a None admin] PATH_INFO: `/v3/domains/50c048406f4f46378c4253f54ad4058d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:11.332266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9e702-7eea-474e-8c13-e78274390e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=50c048406f4f46378c4253f54ad4058d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:11.333708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9e702-7eea-474e-8c13-e78274390e9a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:11.335688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 571/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Fri Jul 1 19:27:11 2022] GET /identity/v3/domains/50c048406f4f46378c4253f54ad4058d => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:11.341932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fe39f-9631-4ea5-a5db-6083e60fc576 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:11.405923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:11.462582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fe39f-9631-4ea5-a5db-6083e60fc576 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:11.501967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c19c58-b859-4c76-88fa-00a947c60c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:11.502629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c19c58-b859-4c76-88fa-00a947c60c74 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:11.502913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c19c58-b859-4c76-88fa-00a947c60c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:11.503189 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c19c58-b859-4c76-88fa-00a947c60c74 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:11.503924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c19c58-b859-4c76-88fa-00a947c60c74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:11.505365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c19c58-b859-4c76-88fa-00a947c60c74 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:11.534504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 602/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:27:11 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:27:13.573649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deca27-e34e-495b-aaa1-c1f450944460 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:13.574287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deca27-e34e-495b-aaa1-c1f450944460 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:13.574287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deca27-e34e-495b-aaa1-c1f450944460 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:13.576419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 572/1174] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:27:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:13.586663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667602-b211-400c-aa89-4d2e35e09d93 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:13.587076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667602-b211-400c-aa89-4d2e35e09d93 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:13.587654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e667602-b211-400c-aa89-4d2e35e09d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:13.620428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4e667602-b211-400c-aa89-4d2e35e09d93 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:13.621635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4e667602-b211-400c-aa89-4d2e35e09d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:13.696600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 603/1175] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:27:13.727695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deca27-e34e-495b-aaa1-c1f450944460 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:13.797474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:13.837832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deca27-e34e-495b-aaa1-c1f450944460 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:13.879767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084a30e-edf3-43f4-afca-e360779db169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:13.880632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a30e-edf3-43f4-afca-e360779db169 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:13.880909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a30e-edf3-43f4-afca-e360779db169 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:13.881181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084a30e-edf3-43f4-afca-e360779db169 None admin] PATH_INFO: `/v3/domains/50c048406f4f46378c4253f54ad4058d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:13.882535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a30e-edf3-43f4-afca-e360779db169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=50c048406f4f46378c4253f54ad4058d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:13.883981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084a30e-edf3-43f4-afca-e360779db169 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:13.885576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 573/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Fri Jul 1 19:27:13 2022] GET /identity/v3/domains/50c048406f4f46378c4253f54ad4058d => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:13.891602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e667602-b211-400c-aa89-4d2e35e09d93 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:13.938961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:14.005367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e667602-b211-400c-aa89-4d2e35e09d93 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:14.041061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59bc7e-e501-4913-a2f1-7cdcb052e64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:14.041723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bc7e-e501-4913-a2f1-7cdcb052e64d None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:14.041997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bc7e-e501-4913-a2f1-7cdcb052e64d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:14.042308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59bc7e-e501-4913-a2f1-7cdcb052e64d None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:14.043022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59bc7e-e501-4913-a2f1-7cdcb052e64d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:14.044449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59bc7e-e501-4913-a2f1-7cdcb052e64d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:14.067101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 604/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:27:13 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:27:16.112427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24bbcf-8aef-4422-ade7-80ac411c80b3 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:16.112959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24bbcf-8aef-4422-ade7-80ac411c80b3 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:16.112959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24bbcf-8aef-4422-ade7-80ac411c80b3 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:16.114403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 574/1178] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:16.120709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141acbac-2748-4f94-963e-71a04a4617a1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:16.121419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141acbac-2748-4f94-963e-71a04a4617a1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:16.121568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141acbac-2748-4f94-963e-71a04a4617a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:16.150015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-141acbac-2748-4f94-963e-71a04a4617a1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:16.151212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-141acbac-2748-4f94-963e-71a04a4617a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:16.227775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 605/1179] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:27:16.251389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24bbcf-8aef-4422-ade7-80ac411c80b3 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:16.361857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24bbcf-8aef-4422-ade7-80ac411c80b3 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:16.396094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9ac19-be50-4dee-b1af-7f3dee56925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:16.396873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ac19-be50-4dee-b1af-7f3dee56925a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:16.397148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ac19-be50-4dee-b1af-7f3dee56925a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:16.397424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ac19-be50-4dee-b1af-7f3dee56925a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:16.399559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:16.412934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9ac19-be50-4dee-b1af-7f3dee56925a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-5ac9ac19-be50-4dee-b1af-7f3dee56925a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:27:16.421329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:27:16.422497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:27:16.423576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:27:16.426136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 575/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:27:16.428766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141acbac-2748-4f94-963e-71a04a4617a1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:16.456306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:16.538714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141acbac-2748-4f94-963e-71a04a4617a1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:16.578645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:16.579321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:16.579603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:16.579884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:16.580639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:27:16.580947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:16.582335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:16.590920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 606/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:27:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:16.597185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9ac19-be50-4dee-b1af-7f3dee56925a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:16.700161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9ac19-be50-4dee-b1af-7f3dee56925a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:16.735839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a967f-3da5-41d4-8ba6-d78c6428c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:16.736692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a967f-3da5-41d4-8ba6-d78c6428c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:16.736968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a967f-3da5-41d4-8ba6-d78c6428c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:16.737236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a967f-3da5-41d4-8ba6-d78c6428c4d0 None admin] PATH_INFO: `/v3/users/47b4e384e7ba441c9a4c3e2afc7b3d15` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:16.751982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a967f-3da5-41d4-8ba6-d78c6428c4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=47b4e384e7ba441c9a4c3e2afc7b3d15)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:16.753521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a967f-3da5-41d4-8ba6-d78c6428c4d0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:16.755174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 576/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:27:16 2022] GET /identity/v3/users/47b4e384e7ba441c9a4c3e2afc7b3d15 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:16.761516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:16.856308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:16.868951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e465bd-1c3e-4485-8841-07b5c6ff5beb None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:16.902747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7276e-9380-4047-8382-29e03eeb2c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:16.903407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7276e-9380-4047-8382-29e03eeb2c7f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:16.903687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7276e-9380-4047-8382-29e03eeb2c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:16.903963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7276e-9380-4047-8382-29e03eeb2c7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:16.975296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7276e-9380-4047-8382-29e03eeb2c7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:16.976737 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7276e-9380-4047-8382-29e03eeb2c7f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:17.085508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:17.100474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 607/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:27:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:27:17.107705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a967f-3da5-41d4-8ba6-d78c6428c4d0 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:17.173529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:17.230962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a967f-3da5-41d4-8ba6-d78c6428c4d0 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:17.266544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370e511-a49c-42a1-8f68-13f7d7e02029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:17.267432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370e511-a49c-42a1-8f68-13f7d7e02029 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:17.267710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370e511-a49c-42a1-8f68-13f7d7e02029 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:17.267986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370e511-a49c-42a1-8f68-13f7d7e02029 None admin] PATH_INFO: `/v3/projects/07780dd3874141e79c4d27494f66bf53` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:17.269282 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370e511-a49c-42a1-8f68-13f7d7e02029 None admin] RBAC: Authorizing `identity:get_project(project_id=07780dd3874141e79c4d27494f66bf53)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:17.270760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370e511-a49c-42a1-8f68-13f7d7e02029 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:17.272455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 577/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:27:17 2022] GET /identity/v3/projects/07780dd3874141e79c4d27494f66bf53 => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:17.281629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7276e-9380-4047-8382-29e03eeb2c7f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:17.387371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7276e-9380-4047-8382-29e03eeb2c7f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:17.432449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f167509-d7b0-4030-b7f1-5879f10f87f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:17.433082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f167509-d7b0-4030-b7f1-5879f10f87f7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:17.433366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f167509-d7b0-4030-b7f1-5879f10f87f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:17.433642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f167509-d7b0-4030-b7f1-5879f10f87f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:17.434515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f167509-d7b0-4030-b7f1-5879f10f87f7 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=07780dd3874141e79c4d27494f66bf53, user.id=47b4e384e7ba441c9a4c3e2afc7b3d15) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:27:17.434830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f167509-d7b0-4030-b7f1-5879f10f87f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:17.436266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f167509-d7b0-4030-b7f1-5879f10f87f7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:17.441799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 608/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:27:17 2022] GET /identity/v3/role_assignments?user.id=47b4e384e7ba441c9a4c3e2afc7b3d15&scope.project.id=07780dd3874141e79c4d27494f66bf53&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:19.410593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63f805-5a3d-4c58-82f4-cca4020e0637 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:19.411432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63f805-5a3d-4c58-82f4-cca4020e0637 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:19.411432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63f805-5a3d-4c58-82f4-cca4020e0637 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:19.413626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 578/1186] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:27:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:19.420609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84da8ac-5a47-42f1-94c5-176cdb78a5a0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:19.421397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84da8ac-5a47-42f1-94c5-176cdb78a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:19.421661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84da8ac-5a47-42f1-94c5-176cdb78a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:19.448834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b84da8ac-5a47-42f1-94c5-176cdb78a5a0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:19.450072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b84da8ac-5a47-42f1-94c5-176cdb78a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:19.501934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:19.526337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 609/1187] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:27:19.549539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63f805-5a3d-4c58-82f4-cca4020e0637 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:19.676227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63f805-5a3d-4c58-82f4-cca4020e0637 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:19.696565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:19.712448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076ad8-b27e-415c-82fc-63f7d16216ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:19.713232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076ad8-b27e-415c-82fc-63f7d16216ba None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:19.713510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076ad8-b27e-415c-82fc-63f7d16216ba None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:19.713782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076ad8-b27e-415c-82fc-63f7d16216ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:19.724311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81076ad8-b27e-415c-82fc-63f7d16216ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-81076ad8-b27e-415c-82fc-63f7d16216ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:27:19.731998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:27:19.733107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:27:19.734315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 579/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:27:19.739640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84da8ac-5a47-42f1-94c5-176cdb78a5a0 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:19.862170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84da8ac-5a47-42f1-94c5-176cdb78a5a0 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:19.908940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:19.909578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:19.909889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:19.910198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:19.910953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:27:19.911262 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:19.912638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:19.920882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 610/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:19.927408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076ad8-b27e-415c-82fc-63f7d16216ba None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:20.033770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076ad8-b27e-415c-82fc-63f7d16216ba None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:20.078223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da80c90-1dda-4ad2-977f-03e7df9517f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:20.079105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da80c90-1dda-4ad2-977f-03e7df9517f6 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:20.079389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da80c90-1dda-4ad2-977f-03e7df9517f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:20.079662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da80c90-1dda-4ad2-977f-03e7df9517f6 None admin] PATH_INFO: `/v3/users/47b4e384e7ba441c9a4c3e2afc7b3d15` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:20.080909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da80c90-1dda-4ad2-977f-03e7df9517f6 None admin] RBAC: Authorizing `identity:get_user(user_id=47b4e384e7ba441c9a4c3e2afc7b3d15)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:20.082376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da80c90-1dda-4ad2-977f-03e7df9517f6 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:20.084023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 580/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:27:19 2022] GET /identity/v3/users/47b4e384e7ba441c9a4c3e2afc7b3d15 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:20.090448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:20.143984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:20.204753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4d803-2f7f-42d0-a699-41c33898a7cf None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:20.242048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050999-8c17-41ee-a193-4fcf36281d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:20.242927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050999-8c17-41ee-a193-4fcf36281d22 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:20.243205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050999-8c17-41ee-a193-4fcf36281d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:20.243483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050999-8c17-41ee-a193-4fcf36281d22 None admin] PATH_INFO: `/v3/projects/07780dd3874141e79c4d27494f66bf53` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:20.244712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e050999-8c17-41ee-a193-4fcf36281d22 None admin] RBAC: Authorizing `identity:get_project(project_id=07780dd3874141e79c4d27494f66bf53)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:20.246209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e050999-8c17-41ee-a193-4fcf36281d22 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:20.247916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 611/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:27:20 2022] GET /identity/v3/projects/07780dd3874141e79c4d27494f66bf53 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:20.253998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da80c90-1dda-4ad2-977f-03e7df9517f6 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:20.307394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:20.361399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da80c90-1dda-4ad2-977f-03e7df9517f6 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:20.396012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b0554-20ac-447f-b44f-4bb4807db143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:20.396887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0554-20ac-447f-b44f-4bb4807db143 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:20.397169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0554-20ac-447f-b44f-4bb4807db143 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:20.397442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b0554-20ac-447f-b44f-4bb4807db143 None admin] PATH_INFO: `/v3/projects/07780dd3874141e79c4d27494f66bf53/users/47b4e384e7ba441c9a4c3e2afc7b3d15/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:20.399557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b0554-20ac-447f-b44f-4bb4807db143 None admin] RBAC: Authorizing `identity:create_grant(project_id=07780dd3874141e79c4d27494f66bf53, user_id=47b4e384e7ba441c9a4c3e2afc7b3d15, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:20.400993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b0554-20ac-447f-b44f-4bb4807db143 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:20.419214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 581/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:27:20 2022] PUT /identity/v3/projects/07780dd3874141e79c4d27494f66bf53/users/47b4e384e7ba441c9a4c3e2afc7b3d15/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:27:22.390665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad6d44-7c22-4144-8239-294c96f9168b None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:22.391203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad6d44-7c22-4144-8239-294c96f9168b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:22.391203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad6d44-7c22-4144-8239-294c96f9168b None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:22.392595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 612/1193] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:27:22.398969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df630de-a31e-435e-9faa-4d24ed5c06b2 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:22.399662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df630de-a31e-435e-9faa-4d24ed5c06b2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:22.399835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df630de-a31e-435e-9faa-4d24ed5c06b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:22.421885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-6df630de-a31e-435e-9faa-4d24ed5c06b2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:27:22.423078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6df630de-a31e-435e-9faa-4d24ed5c06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:27:22.494368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 582/1194] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:27:22.523673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad6d44-7c22-4144-8239-294c96f9168b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:22.636663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad6d44-7c22-4144-8239-294c96f9168b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:22.649753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:22.673333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3d43a-f754-4ea0-8c97-18ca0dcfd880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:22.674136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3d43a-f754-4ea0-8c97-18ca0dcfd880 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:22.674412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3d43a-f754-4ea0-8c97-18ca0dcfd880 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:22.674663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3d43a-f754-4ea0-8c97-18ca0dcfd880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:22.685645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e3d43a-f754-4ea0-8c97-18ca0dcfd880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-f2e3d43a-f754-4ea0-8c97-18ca0dcfd880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:27:22.693379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:27:22.694567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:27:22.695572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 613/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:27:22.701414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df630de-a31e-435e-9faa-4d24ed5c06b2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:22.744637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:22.807764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df630de-a31e-435e-9faa-4d24ed5c06b2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:22.843649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:22.844303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:22.844586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:22.844863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:22.845611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:27:22.845916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:22.847319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:22.855581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 583/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:27:22.864757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3d43a-f754-4ea0-8c97-18ca0dcfd880 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:22.977144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3d43a-f754-4ea0-8c97-18ca0dcfd880 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:23.015863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323613-f1a3-4abf-ba4c-bc3cd1f01421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:23.017173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323613-f1a3-4abf-ba4c-bc3cd1f01421 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:23.017576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323613-f1a3-4abf-ba4c-bc3cd1f01421 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:23.017867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e323613-f1a3-4abf-ba4c-bc3cd1f01421 None admin] PATH_INFO: `/v3/users/47b4e384e7ba441c9a4c3e2afc7b3d15` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:23.019897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e323613-f1a3-4abf-ba4c-bc3cd1f01421 None admin] RBAC: Authorizing `identity:get_user(user_id=47b4e384e7ba441c9a4c3e2afc7b3d15)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:23.021799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e323613-f1a3-4abf-ba4c-bc3cd1f01421 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:23.023745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 614/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Fri Jul 1 19:27:22 2022] GET /identity/v3/users/47b4e384e7ba441c9a4c3e2afc7b3d15 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:23.029747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:23.147203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:23.150744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8d529-bb23-49cb-9521-05487f0fd846 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:23.184854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db11406-25ef-4e73-b53b-29b49ebc3594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:23.185489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db11406-25ef-4e73-b53b-29b49ebc3594 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:23.185769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db11406-25ef-4e73-b53b-29b49ebc3594 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:23.186179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db11406-25ef-4e73-b53b-29b49ebc3594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:23.255139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db11406-25ef-4e73-b53b-29b49ebc3594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:23.256508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db11406-25ef-4e73-b53b-29b49ebc3594 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:23.352867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:23.356603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 584/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:27:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:27:23.363483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323613-f1a3-4abf-ba4c-bc3cd1f01421 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:23.414469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:23.474066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e323613-f1a3-4abf-ba4c-bc3cd1f01421 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:23.508624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab66911-59b1-4b2c-800d-0af29c407749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:23.509412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66911-59b1-4b2c-800d-0af29c407749 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:23.509699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66911-59b1-4b2c-800d-0af29c407749 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:23.510086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab66911-59b1-4b2c-800d-0af29c407749 None admin] PATH_INFO: `/v3/projects/07780dd3874141e79c4d27494f66bf53` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:23.511390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab66911-59b1-4b2c-800d-0af29c407749 None admin] RBAC: Authorizing `identity:get_project(project_id=07780dd3874141e79c4d27494f66bf53)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:23.512842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab66911-59b1-4b2c-800d-0af29c407749 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:23.514553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 615/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Fri Jul 1 19:27:23 2022] GET /identity/v3/projects/07780dd3874141e79c4d27494f66bf53 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:23.524319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db11406-25ef-4e73-b53b-29b49ebc3594 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:27:23.635992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db11406-25ef-4e73-b53b-29b49ebc3594 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:27:23.671766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ed880-24bb-4ccb-a1af-3dcbce2110a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:27:23.672410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed880-24bb-4ccb-a1af-3dcbce2110a3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:27:23.672692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed880-24bb-4ccb-a1af-3dcbce2110a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:27:23.672966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ed880-24bb-4ccb-a1af-3dcbce2110a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:27:23.673796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ed880-24bb-4ccb-a1af-3dcbce2110a3 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=07780dd3874141e79c4d27494f66bf53, user.id=47b4e384e7ba441c9a4c3e2afc7b3d15) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:27:23.674145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ed880-24bb-4ccb-a1af-3dcbce2110a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:27:23.675595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ed880-24bb-4ccb-a1af-3dcbce2110a3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:27:23.682177 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 585/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:27:23 2022] GET /identity/v3/role_assignments?user.id=47b4e384e7ba441c9a4c3e2afc7b3d15&scope.project.id=07780dd3874141e79c4d27494f66bf53&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:27:33.503577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=46 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:27:33.678981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=68 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:18.479487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf2b8-5035-4e14-973c-7642d36fd065 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:18.480104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf2b8-5035-4e14-973c-7642d36fd065 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:18.480104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bf2b8-5035-4e14-973c-7642d36fd065 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:18.481579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 616/1201] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:18.486622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe5cc-e58e-46b0-8291-dcf5b5bb9cfe None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:18.487175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe5cc-e58e-46b0-8291-dcf5b5bb9cfe None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:18.487342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fe5cc-e58e-46b0-8291-dcf5b5bb9cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:18.506368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b11fe5cc-e58e-46b0-8291-dcf5b5bb9cfe None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:18.507557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b11fe5cc-e58e-46b0-8291-dcf5b5bb9cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:18.595603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 586/1202] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 19:28:18.620844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf2b8-5035-4e14-973c-7642d36fd065 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:18.748055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bf2b8-5035-4e14-973c-7642d36fd065 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:18.793545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:18.794536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:18.794941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:18.795267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:18.808307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:18.809861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:18.828173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:18.829261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:18.830736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:18.830736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:18.830736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:18.830736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:18.835032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 617/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:18.836245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fe5cc-e58e-46b0-8291-dcf5b5bb9cfe None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:18.970827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fe5cc-e58e-46b0-8291-dcf5b5bb9cfe None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:19.009977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:19.023326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15316a7d-05f7-4612-91b0-620ae5707163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:19.024068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316a7d-05f7-4612-91b0-620ae5707163 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:19.024355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316a7d-05f7-4612-91b0-620ae5707163 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:19.024628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15316a7d-05f7-4612-91b0-620ae5707163 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:19.025354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316a7d-05f7-4612-91b0-620ae5707163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:19.025693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316a7d-05f7-4612-91b0-620ae5707163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:19.027089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15316a7d-05f7-4612-91b0-620ae5707163 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:19.044198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 587/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:19.045668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:19.116487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:19.178243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b2b21-e350-473d-8c7e-8e1f4c5518e5 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:19.225614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c1cdb-3e17-43b5-8865-fe3809526778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:19.230303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c1cdb-3e17-43b5-8865-fe3809526778 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:19.230303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c1cdb-3e17-43b5-8865-fe3809526778 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:19.230303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c1cdb-3e17-43b5-8865-fe3809526778 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:19.230303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c1cdb-3e17-43b5-8865-fe3809526778 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:19.230303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c1cdb-3e17-43b5-8865-fe3809526778 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:19.252944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 618/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Fri Jul 1 19:28:19 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:28:21.410646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee01c-a327-449a-8110-ba82f757e625 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:21.411235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee01c-a327-449a-8110-ba82f757e625 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:21.411235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fee01c-a327-449a-8110-ba82f757e625 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:21.412662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 588/1206] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:21.418185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4806-f1ee-4244-895d-3757514379fd None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:21.418655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4806-f1ee-4244-895d-3757514379fd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:21.418859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae4806-f1ee-4244-895d-3757514379fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:21.437055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4cae4806-f1ee-4244-895d-3757514379fd None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:21.438518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4cae4806-f1ee-4244-895d-3757514379fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:21.513516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 619/1207] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:21.539270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fee01c-a327-449a-8110-ba82f757e625 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:21.670572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fee01c-a327-449a-8110-ba82f757e625 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:21.712067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0fc63-894a-4311-9c13-60ee07552169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:21.712818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0fc63-894a-4311-9c13-60ee07552169 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:21.713103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0fc63-894a-4311-9c13-60ee07552169 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:21.713403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0fc63-894a-4311-9c13-60ee07552169 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:21.726365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0fc63-894a-4311-9c13-60ee07552169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-dfd0fc63-894a-4311-9c13-60ee07552169 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:28:21.734241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:21.735409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:21.736288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 589/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:28:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:21.742290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae4806-f1ee-4244-895d-3757514379fd None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:21.785643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:21.854384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae4806-f1ee-4244-895d-3757514379fd None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:21.894216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:21.894933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:21.895197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:21.895485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:21.896224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:21.896536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:21.897970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:21.909185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 620/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:28:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:21.915826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0fc63-894a-4311-9c13-60ee07552169 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:21.976887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:22.031995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0fc63-894a-4311-9c13-60ee07552169 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:22.077588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:22.078515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:22.078798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:22.079154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:22.090549 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:22.092086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:22.111259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:22.112321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:22.118730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:22.118730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:22.118730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:22.118730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:22.118730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 590/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:22.119896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:22.217981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:22.221344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004decc-a12f-4a6f-9da4-7ebc530b5b0a None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:22.261410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:22.261410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:22.261744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:22.262099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:22.263160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:22.263273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:22.264738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:22.277788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 621/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:22.283269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:22.395652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b9e6-8b7c-47d6-b83e-54370b348339 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:22.397286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:22.436418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:22.437256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:22.437540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:22.437812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:22.445927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:22.447452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:28:22.465713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:22.466803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:22.467858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 591/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:22.475368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:22.588500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255c546b-5b7e-41e8-bc87-5bc0b81e2133 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:22.627800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:22.628470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:22.628788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:22.629088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:22.630025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:22.630341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:22.632087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:22.651037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 622/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jul 1 19:28:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:28:22.657279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:22.788664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac2b98-0967-4207-9558-4e33cf72dad3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:22.833319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf574133-bf45-47ea-8395-4c2060ecc935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:22.834533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574133-bf45-47ea-8395-4c2060ecc935 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:22.835889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574133-bf45-47ea-8395-4c2060ecc935 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:22.835889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf574133-bf45-47ea-8395-4c2060ecc935 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:22.876437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:22.928399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf574133-bf45-47ea-8395-4c2060ecc935 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:22.930126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf574133-bf45-47ea-8395-4c2060ecc935 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:23.053306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 592/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:28:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:28:23.059626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:23.084858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:23.177465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c3d81-a558-48d5-9f5c-1c1969cad0c5 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:23.215038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:23.215866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:23.216149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:23.216436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:23.227201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:23.228608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:23.246884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:23.248075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:23.248989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:23.248989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:23.248989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:23.248989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:23.248989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 623/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 19:28:23.254168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf574133-bf45-47ea-8395-4c2060ecc935 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:23.335326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:23.380315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf574133-bf45-47ea-8395-4c2060ecc935 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:23.420216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:23.421031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:23.421357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:23.421669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:23.422473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:23.423429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:23.424321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:23.437866 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 593/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:28:23.443613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:23.520267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:23.555785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d716-f260-48a4-a7bb-0e3c9b30bbc1 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:23.593403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:23.594353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:23.594684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:23.594926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:23.602809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:23.604369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:28:23.619161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:23.620997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:23.621903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:28:23.621903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:28:23.621903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:28:23.621903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:28:23.621903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:28:23.621903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:28:23.621903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:23.621903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:23.625649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 624/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:23.626695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:23.736408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56211aa0-b225-447c-9163-8ededd2a4360 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:23.759842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:23.773323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810699-dccd-4ba0-89a9-c8d9f73e43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:23.774082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810699-dccd-4ba0-89a9-c8d9f73e43a7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:23.774379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810699-dccd-4ba0-89a9-c8d9f73e43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:23.774661 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810699-dccd-4ba0-89a9-c8d9f73e43a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:23.775498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810699-dccd-4ba0-89a9-c8d9f73e43a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:23.775768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810699-dccd-4ba0-89a9-c8d9f73e43a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:23.777313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810699-dccd-4ba0-89a9-c8d9f73e43a7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:23.790497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 594/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:23.796952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:23.915688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776000f-30d6-4ab9-a592-aafc9a255c21 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:23.945565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:23.951960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e56a2-1c3b-422b-b71d-cb8552e5340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:23.952715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e56a2-1c3b-422b-b71d-cb8552e5340d None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:23.952987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e56a2-1c3b-422b-b71d-cb8552e5340d None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:23.953306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e56a2-1c3b-422b-b71d-cb8552e5340d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:23.954226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e56a2-1c3b-422b-b71d-cb8552e5340d None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=6f6684cfbbc54d568730d44c923770ea) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:23.954583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e56a2-1c3b-422b-b71d-cb8552e5340d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:23.956085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e56a2-1c3b-422b-b71d-cb8552e5340d None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:23.969474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 625/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:28:23 2022] GET /identity/v3/role_assignments?user.id=6f6684cfbbc54d568730d44c923770ea&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:26.012916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f379-e333-4fa5-9aba-10820a586854 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.013461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f379-e333-4fa5-9aba-10820a586854 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.013461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027f379-e333-4fa5-9aba-10820a586854 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.014884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 595/1220] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:26.020237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d626d-0e53-4333-b7df-bae3cac4a857 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.020705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d626d-0e53-4333-b7df-bae3cac4a857 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.020818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d626d-0e53-4333-b7df-bae3cac4a857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.040713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-999d626d-0e53-4333-b7df-bae3cac4a857 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:26.042124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-999d626d-0e53-4333-b7df-bae3cac4a857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:26.116553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 626/1221] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:26.141979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027f379-e333-4fa5-9aba-10820a586854 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:26.250632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027f379-e333-4fa5-9aba-10820a586854 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:26.284557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ac33d-3584-48c9-85cd-bfdea713d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:26.285289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac33d-3584-48c9-85cd-bfdea713d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.285570 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac33d-3584-48c9-85cd-bfdea713d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.285857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ac33d-3584-48c9-85cd-bfdea713d4e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.297116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ac33d-3584-48c9-85cd-bfdea713d4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ab1ac33d-3584-48c9-85cd-bfdea713d4e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:28:26.305620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:26.306985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:26.307831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 596/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:26.313317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d626d-0e53-4333-b7df-bae3cac4a857 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:26.426043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d626d-0e53-4333-b7df-bae3cac4a857 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:26.452731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:26.465143 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:26.465994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.466310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.466585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.467504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:26.467816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:26.469328 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:26.478049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 627/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:28:26.485130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ac33d-3584-48c9-85cd-bfdea713d4e7 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:26.532532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:26.595378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ac33d-3584-48c9-85cd-bfdea713d4e7 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:26.632123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:26.632920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.633287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.633488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.645448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:26.647066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:26.664633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:26.665716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:26.666696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:26.666696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:26.666696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:26.666696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:26.666696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 597/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:26.671899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:26.775679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8c2ea-6d85-4ff1-ab80-c12b6c76efc2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:26.814717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:26.815367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.815651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.815907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.816652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:26.816982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:26.818398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:26.832789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 628/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:26.839839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:26.938838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:26.946114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa21e51-8b61-419d-b6e0-d1c0d1c1648c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:26.983739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:26.984838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:26.985191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:26.985650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:26.994745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:26.996331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:28:27.011917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:27.013535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:27.014511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 598/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:27.019220 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:27.069209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:27.123701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed2313-8ede-4126-b403-7b3ea4d413e5 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:27.168616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:27.169322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:27.169602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:27.169869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:27.170826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:27.171106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:27.172664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:27.192425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 629/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jul 1 19:28:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:27.198313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:27.300036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9546d-e516-460d-993b-a90cb16bc7d1 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:27.337529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:27.338410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:27.338738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:27.339157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:27.352108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:27.353584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:27.371600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:27.372961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:27.374336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:27.374336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:27.374336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:27.374336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:27.375358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 599/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:27.381663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:27.486005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0bedc-3e99-47c9-9bc0-d26c1e72f8fe None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:27.488392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:27.522860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:27.523510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:27.523850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:27.524152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:27.524847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:27.525157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:27.526576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:27.538185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 630/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:27.544910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:27.562619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:27.667729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bef051-e844-47ff-a230-ba69c1e0ee3c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:27.703545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:27.704352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:27.704667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:27.704948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:27.712497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:27.714122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:28:27.728418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:27.729608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:27.735543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 600/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:27.736160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:27.844485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36963ff7-505c-49e1-b6ba-def2619d8283 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:27.880301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85eddc-10ea-46be-a503-3ed8cf5a84c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:27.880954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85eddc-10ea-46be-a503-3ed8cf5a84c7 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:27.881279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85eddc-10ea-46be-a503-3ed8cf5a84c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:27.881617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85eddc-10ea-46be-a503-3ed8cf5a84c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:27.882447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85eddc-10ea-46be-a503-3ed8cf5a84c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:27.882753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85eddc-10ea-46be-a503-3ed8cf5a84c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:27.884225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85eddc-10ea-46be-a503-3ed8cf5a84c7 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:27.896542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 631/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:27.902648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:27.969111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:28.004626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434d1d6-a319-4e04-815d-bfde117124b6 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:28.038913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2de0b-f576-49a6-81f9-c7c389e8f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:28.039824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2de0b-f576-49a6-81f9-c7c389e8f7e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:28.040116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2de0b-f576-49a6-81f9-c7c389e8f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:28.040396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2de0b-f576-49a6-81f9-c7c389e8f7e7 None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/6f6684cfbbc54d568730d44c923770ea/roles/30dcb64cd7824d3ca9b1918b76d8e443` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:28.062360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2de0b-f576-49a6-81f9-c7c389e8f7e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=6f6684cfbbc54d568730d44c923770ea, role_id=30dcb64cd7824d3ca9b1918b76d8e443)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:28.063828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2de0b-f576-49a6-81f9-c7c389e8f7e7 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:28.079322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 601/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:28:27 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/6f6684cfbbc54d568730d44c923770ea/roles/30dcb64cd7824d3ca9b1918b76d8e443 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:28:30.205594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b485a-7aef-41a6-9fb7-fa38d678ceac None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:30.206179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b485a-7aef-41a6-9fb7-fa38d678ceac None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:30.206179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b485a-7aef-41a6-9fb7-fa38d678ceac None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:30.207823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 632/1233] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:28:30.213858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc402-b6af-498f-a322-be391fdda472 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:30.214490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc402-b6af-498f-a322-be391fdda472 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:30.214578 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cc402-b6af-498f-a322-be391fdda472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:30.231577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c44cc402-b6af-498f-a322-be391fdda472 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:30.232756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c44cc402-b6af-498f-a322-be391fdda472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:30.312371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 602/1234] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:30.338859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b485a-7aef-41a6-9fb7-fa38d678ceac None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:30.366332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:30.452665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b485a-7aef-41a6-9fb7-fa38d678ceac None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:30.488695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b685-1f9f-46c6-8e19-3176c19775e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:30.489510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b685-1f9f-46c6-8e19-3176c19775e5 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:30.489791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b685-1f9f-46c6-8e19-3176c19775e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:30.490108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c043b685-1f9f-46c6-8e19-3176c19775e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:30.501259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c043b685-1f9f-46c6-8e19-3176c19775e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-c043b685-1f9f-46c6-8e19-3176c19775e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:28:30.510248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:30.511364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:30.512392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 633/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Fri Jul 1 19:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:30.520302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc402-b6af-498f-a322-be391fdda472 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:30.568831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:30.622881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cc402-b6af-498f-a322-be391fdda472 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:30.658475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:30.659228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:30.659572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:30.659845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:30.660590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:30.660892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:30.662285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:30.671920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 603/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Fri Jul 1 19:28:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:30.678233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b685-1f9f-46c6-8e19-3176c19775e5 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:30.768913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:30.786601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c043b685-1f9f-46c6-8e19-3176c19775e5 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:30.825569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:30.826439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:30.826915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:30.827108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:30.839669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:30.841194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:30.860602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:30.861754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:30.862962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:30.862962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:30.862962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:30.862962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:30.862962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 634/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:30.868172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:30.974366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14c961-c6e2-4e74-a511-c76e085e99d5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:30.985605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:31.012380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:31.013058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:31.013452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:31.013734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:31.014629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:31.014942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:31.016534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:31.033078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 604/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:31.034343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:31.148475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177b13-8d97-4f02-ac57-ad23b3dae42b None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:31.185284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:31.186136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:31.186421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:31.186700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:31.189499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:31.195241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:31.196722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:28:31.211485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:31.213025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:31.214217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:31.217598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 635/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:31.218830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:31.345663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd5ee-4ef5-415c-8bf8-d3d36b87098d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:31.382985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:31.383718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:31.383994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:31.384266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:31.385099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:31.385409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:31.387043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:31.406145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 605/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jul 1 19:28:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:31.412232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:31.518870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42346fb9-9663-46bf-a8fc-3f6b9d12cdfd None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:31.557579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed23030-1900-418a-a5e1-502d4f11016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:31.558295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed23030-1900-418a-a5e1-502d4f11016e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:31.558548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed23030-1900-418a-a5e1-502d4f11016e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:31.558834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed23030-1900-418a-a5e1-502d4f11016e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:31.622210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:31.629682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed23030-1900-418a-a5e1-502d4f11016e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:31.631330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed23030-1900-418a-a5e1-502d4f11016e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:31.753385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 636/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:28:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:28:31.753566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:31.781700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:31.874431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4a9b0-b821-4c0e-be35-147fe69da985 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:31.909864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:31.910862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:31.911141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:31.911498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:31.923011 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:31.924696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:31.945553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:31.946757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:31.947695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:31.947695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:31.947695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:31.947695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:31.947695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 606/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:31.952675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed23030-1900-418a-a5e1-502d4f11016e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:32.056924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:32.067678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed23030-1900-418a-a5e1-502d4f11016e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:32.107533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:32.108252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:32.108531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:32.108803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:32.109529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:32.109833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:32.111234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:32.123378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 637/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:32.129579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:32.209890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:32.231802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3505-f768-492f-802e-39d7b61403ef None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:32.269653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:32.270491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:32.270819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:32.271100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:32.278034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:32.279493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:28:32.293837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:32.300740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:32.302060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 607/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:32.302680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:32.410871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b272e-a69d-41d7-b146-94d816234ba3 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:32.445250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfabc34-e407-4307-959f-05c512bb4de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:32.445985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabc34-e407-4307-959f-05c512bb4de0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:32.446251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabc34-e407-4307-959f-05c512bb4de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:32.446527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabc34-e407-4307-959f-05c512bb4de0 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:32.447326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfabc34-e407-4307-959f-05c512bb4de0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:32.447632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfabc34-e407-4307-959f-05c512bb4de0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:32.449065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfabc34-e407-4307-959f-05c512bb4de0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:32.461972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 638/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:32.467975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:32.582733 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0ddc5-4818-48c3-ad9c-3164741fa1b1 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:32.619349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c74b1-a3db-412c-9245-81ec89079df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:32.620207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c74b1-a3db-412c-9245-81ec89079df9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:32.620588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c74b1-a3db-412c-9245-81ec89079df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:32.620965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c74b1-a3db-412c-9245-81ec89079df9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:32.621877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c74b1-a3db-412c-9245-81ec89079df9 None admin] RBAC: Adding query filter params (role.id=30dcb64cd7824d3ca9b1918b76d8e443, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=6f6684cfbbc54d568730d44c923770ea) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:32.622218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c74b1-a3db-412c-9245-81ec89079df9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:32.623820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c74b1-a3db-412c-9245-81ec89079df9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:32.630170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 608/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:28:32 2022] GET /identity/v3/role_assignments?user.id=6f6684cfbbc54d568730d44c923770ea&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=30dcb64cd7824d3ca9b1918b76d8e443 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:34.821659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792cbef-44a5-43e3-a766-27c8e39ad8bf None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:34.822375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792cbef-44a5-43e3-a766-27c8e39ad8bf None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:34.822503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792cbef-44a5-43e3-a766-27c8e39ad8bf None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:34.824459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 639/1247] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:34.830051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb307b-639f-42f2-98d8-d2c1bd10b706 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:34.830506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb307b-639f-42f2-98d8-d2c1bd10b706 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:34.830612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb307b-639f-42f2-98d8-d2c1bd10b706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:34.836733 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:34.849632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c8cb307b-639f-42f2-98d8-d2c1bd10b706 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:34.850942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c8cb307b-639f-42f2-98d8-d2c1bd10b706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:34.928388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 609/1248] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:34.963293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792cbef-44a5-43e3-a766-27c8e39ad8bf None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:34.983291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:35.081417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792cbef-44a5-43e3-a766-27c8e39ad8bf None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:35.121459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73811893-5c2c-49a1-8bb8-58e6f2ab4b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:35.122284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811893-5c2c-49a1-8bb8-58e6f2ab4b61 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:35.122593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811893-5c2c-49a1-8bb8-58e6f2ab4b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:35.122891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73811893-5c2c-49a1-8bb8-58e6f2ab4b61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:35.134444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73811893-5c2c-49a1-8bb8-58e6f2ab4b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-73811893-5c2c-49a1-8bb8-58e6f2ab4b61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:28:35.142382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:35.143531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:35.144358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 640/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:35.149883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb307b-639f-42f2-98d8-d2c1bd10b706 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:35.256385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb307b-639f-42f2-98d8-d2c1bd10b706 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:35.294979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:35.300839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:35.301586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:35.301865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:35.302203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:35.303004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:35.303257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:35.304604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:35.315236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 610/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:35.320966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73811893-5c2c-49a1-8bb8-58e6f2ab4b61 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:35.411273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:35.440681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73811893-5c2c-49a1-8bb8-58e6f2ab4b61 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:35.478740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:35.479547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:35.479831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:35.480104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:35.492070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:35.493648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:35.512523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:35.513978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:35.515046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:35.515046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:35.515046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:35.515046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:35.515046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 641/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:35.519959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:35.629840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3583204-bc59-4bb6-8d07-cb829674771a None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:35.665660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:35.666288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:35.666611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:35.666868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:35.667573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:35.667908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:35.669275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:35.684601 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 611/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:35.691138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:35.796010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb3c3-3aab-4492-ada2-0e4f8028beca None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:35.823951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:35.832964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:35.833769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:35.834562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:35.834795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:35.843188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:35.845006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:28:35.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:35.864177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:35.865313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:35.866304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 642/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:35.873349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:35.939777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:35.994407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6248eef-d843-4b35-81db-0fc6125bf4aa None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:36.034122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:36.034809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:36.035163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:36.035456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:36.036587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:36.036873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:36.038446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:36.065128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:36.066204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 612/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jul 1 19:28:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:28:36.176107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f32e9-061d-40d1-a40d-027a054bf99e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:36.214594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cdc65-4953-4b9b-9cbf-4f3eb3979596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:36.215012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cdc65-4953-4b9b-9cbf-4f3eb3979596 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:36.215285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cdc65-4953-4b9b-9cbf-4f3eb3979596 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:36.215678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cdc65-4953-4b9b-9cbf-4f3eb3979596 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:36.276859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:36.290224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cdc65-4953-4b9b-9cbf-4f3eb3979596 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:36.291715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cdc65-4953-4b9b-9cbf-4f3eb3979596 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:36.404716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 643/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:28:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:28:36.410966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:36.518443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33bd17-2efd-4958-b425-232c309f9233 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:36.533590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:36.558867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:36.559760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:36.560041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:36.560313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:36.571423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:36.573233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:36.593001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:36.594207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:36.595214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:36.595214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:36.595214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:36.595214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:36.595214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 613/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:36.600500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cdc65-4953-4b9b-9cbf-4f3eb3979596 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:36.698598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:36.715094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cdc65-4953-4b9b-9cbf-4f3eb3979596 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:36.753520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:36.754360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:36.754706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:36.755042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:36.755854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:36.756233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:36.757758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:36.769491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 644/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:28:36.775348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:36.887117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3e109-dfb0-4cb7-a52f-c186205c97f9 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:36.924832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:36.925630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:36.925911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:36.926212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:36.934317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:36.935771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:28:36.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:36.952217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:36.953340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 614/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:36.959348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:37.075524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fe016-d1dd-4acd-894c-5e63ce9f13eb None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:37.119413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb58690-4c07-453d-81fb-54fd9392b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:37.120111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58690-4c07-453d-81fb-54fd9392b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:37.120392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58690-4c07-453d-81fb-54fd9392b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:37.120670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb58690-4c07-453d-81fb-54fd9392b4c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:37.121465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb58690-4c07-453d-81fb-54fd9392b4c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:37.121776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb58690-4c07-453d-81fb-54fd9392b4c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:37.123253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb58690-4c07-453d-81fb-54fd9392b4c0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:37.136238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 645/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:37.143220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:37.170354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:37.247323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a92502-b8d2-410d-a74c-77a5e289558c None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:37.283467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eb301-48cc-4a1a-aa25-549506b64ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:37.284122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb301-48cc-4a1a-aa25-549506b64ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:37.284407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb301-48cc-4a1a-aa25-549506b64ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:37.284683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eb301-48cc-4a1a-aa25-549506b64ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:37.285509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb301-48cc-4a1a-aa25-549506b64ce0 None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=6f6684cfbbc54d568730d44c923770ea) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:37.285822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb301-48cc-4a1a-aa25-549506b64ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:37.287311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eb301-48cc-4a1a-aa25-549506b64ce0 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:37.295934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 615/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:28:37 2022] GET /identity/v3/role_assignments?user.id=6f6684cfbbc54d568730d44c923770ea&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:39.390925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230ca4-6364-42f3-833c-f0a4df9e7b7f None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:39.391484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230ca4-6364-42f3-833c-f0a4df9e7b7f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:39.391484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56230ca4-6364-42f3-833c-f0a4df9e7b7f None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:39.392871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 646/1261] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:39.400246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fd367-a203-4df4-88b8-3e96f7b4837f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:39.400994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fd367-a203-4df4-88b8-3e96f7b4837f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:39.401123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fd367-a203-4df4-88b8-3e96f7b4837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:39.425147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-742fd367-a203-4df4-88b8-3e96f7b4837f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:39.426383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-742fd367-a203-4df4-88b8-3e96f7b4837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:39.507661 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 616/1262] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:39.543051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56230ca4-6364-42f3-833c-f0a4df9e7b7f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:39.555355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:39.656838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56230ca4-6364-42f3-833c-f0a4df9e7b7f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:39.691947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310bb0-d69b-4e44-9e98-1d482ba78560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:39.692709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310bb0-d69b-4e44-9e98-1d482ba78560 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:39.692988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310bb0-d69b-4e44-9e98-1d482ba78560 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:39.693268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7310bb0-d69b-4e44-9e98-1d482ba78560 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:39.704353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7310bb0-d69b-4e44-9e98-1d482ba78560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-a7310bb0-d69b-4e44-9e98-1d482ba78560 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:28:39.712405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:39.713512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:39.714797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 647/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:28:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:39.719953 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fd367-a203-4df4-88b8-3e96f7b4837f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:39.741643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:39.840204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fd367-a203-4df4-88b8-3e96f7b4837f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:39.881313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:39.882038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:39.882325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:39.882604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:39.883385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:39.883691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:39.885091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:39.893724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 617/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:28:39.899816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310bb0-d69b-4e44-9e98-1d482ba78560 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:39.973577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:40.008436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7310bb0-d69b-4e44-9e98-1d482ba78560 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:40.047873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:40.048656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.048939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.049277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.063988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:40.066288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:40.085342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:40.086337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:40.087386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:40.087386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:40.087386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:40.087386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:40.087386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 648/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:40.092699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:40.198545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:40.219172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db5c5b-3143-4a79-8633-516490624f3b None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:40.255749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:40.256326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.256598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.256864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.257582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:40.258096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:40.259480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:40.272010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 618/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:40.278722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:40.396897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa65b1-9adf-4706-9875-7ee35a488f12 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:40.417965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:40.433694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:40.434512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.434795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.435068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.442634 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:40.444086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:28:40.458322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:40.459682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:40.461093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 649/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:40.468619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:40.577482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12abb04-e0e2-4e24-8ecd-f1e9b8c7d638 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:40.613305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:40.613979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.614258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.614529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.615361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:40.615666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:40.617100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:40.625920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:40.634950 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 619/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jul 1 19:28:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:40.641392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:40.754851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cc710-1241-4d80-b049-12337818f36f None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:40.791735 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:40.792518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.792796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.793066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.805483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:40.807019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:40.827868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:40.828778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:40.830014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:40.830014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:40.830014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:40.830014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:40.830014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 650/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:40.836430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:40.941201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3033da-47b3-4c6d-80f4-64985b7937d8 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:40.977161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:40.977812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:40.978123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:40.978391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:40.979107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:40.979417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:40.980786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:40.992085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 620/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:40.998147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:41.036048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:41.113531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c556ecd-a555-433e-aa5d-27a2596e8677 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:41.148984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:41.149760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:41.150069 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:41.150349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:41.157871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:41.160588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:28:41.177712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:41.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:41.179811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 651/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:41.185103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:41.248631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:41.291456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975af303-2999-4775-bb1e-0f9af2197ee3 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:41.329312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96341481-bd10-41a6-8275-ec923016f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:41.330621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96341481-bd10-41a6-8275-ec923016f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:41.331344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96341481-bd10-41a6-8275-ec923016f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:41.331766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96341481-bd10-41a6-8275-ec923016f1eb None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:41.332970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96341481-bd10-41a6-8275-ec923016f1eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:41.333384 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96341481-bd10-41a6-8275-ec923016f1eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:41.336002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96341481-bd10-41a6-8275-ec923016f1eb None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:41.350778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 621/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:28:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:41.360346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:41.458399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:41.473280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a3662-c708-4cd1-8879-0cb16109b2be None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:41.512715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1491c3-e5cc-4b34-9955-28ea11021918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:41.513593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1491c3-e5cc-4b34-9955-28ea11021918 None admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:41.513871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1491c3-e5cc-4b34-9955-28ea11021918 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:41.514177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1491c3-e5cc-4b34-9955-28ea11021918 None admin] PATH_INFO: `/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/6f6684cfbbc54d568730d44c923770ea/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:41.516429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1491c3-e5cc-4b34-9955-28ea11021918 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c4357b276a7478bac1f9e6086fd8ceb, user_id=6f6684cfbbc54d568730d44c923770ea, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:41.517885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1491c3-e5cc-4b34-9955-28ea11021918 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:41.534321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 652/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Fri Jul 1 19:28:41 2022] PUT /identity/v3/projects/0c4357b276a7478bac1f9e6086fd8ceb/users/6f6684cfbbc54d568730d44c923770ea/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:28:43.520968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643454-71a7-4a80-9f99-6db0cc9b2e5b None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:43.521830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643454-71a7-4a80-9f99-6db0cc9b2e5b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:43.521830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643454-71a7-4a80-9f99-6db0cc9b2e5b None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:43.524094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 622/1274] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:43.529389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d36f7c-0626-4117-9b7a-f041d117f7ef None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:43.529819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d36f7c-0626-4117-9b7a-f041d117f7ef None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:43.530022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d36f7c-0626-4117-9b7a-f041d117f7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:43.547119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b1d36f7c-0626-4117-9b7a-f041d117f7ef None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:43.548305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b1d36f7c-0626-4117-9b7a-f041d117f7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:43.616511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 653/1275] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:43.640519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2643454-71a7-4a80-9f99-6db0cc9b2e5b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:43.753008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2643454-71a7-4a80-9f99-6db0cc9b2e5b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:43.770262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:43.794248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d023325-6e87-4431-99e4-30471fc65467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:43.794977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d023325-6e87-4431-99e4-30471fc65467 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:43.795259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d023325-6e87-4431-99e4-30471fc65467 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:43.795545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d023325-6e87-4431-99e4-30471fc65467 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:43.805993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d023325-6e87-4431-99e4-30471fc65467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-3d023325-6e87-4431-99e4-30471fc65467 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 19:28:43.813666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:43.814915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:43.815939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 623/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Fri Jul 1 19:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:43.821408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d36f7c-0626-4117-9b7a-f041d117f7ef None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:43.909993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:43.929287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d36f7c-0626-4117-9b7a-f041d117f7ef None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:43.964603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:43.965261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:43.965544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:43.965816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:43.966597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:43.966906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:43.968277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:43.976460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 654/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Fri Jul 1 19:28:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:43.983054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d023325-6e87-4431-99e4-30471fc65467 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:44.102134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d023325-6e87-4431-99e4-30471fc65467 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:44.137781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:44.138592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:44.138869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:44.139139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:44.150567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:44.152009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:44.169222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:44.170243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:44.171273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:44.171273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:44.171273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:44.171273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:44.171273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 624/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:44.176921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:44.283662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25570b4-8b7f-4187-a41e-04f1b58f9508 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:44.318616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:44.319194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:44.319451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:44.319752 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:44.320463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:44.320772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:44.322288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:44.334533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 655/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:44.343816 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:44.388753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:44.468311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed5c18-34d0-4735-95d8-74efc60b7940 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:44.502824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:44.503619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:44.503857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:44.504152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:44.511867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:44.513312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 19:28:44.527852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:44.529278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:44.530396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 625/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:44.536512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:44.540554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:44.650195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aea553-b59e-49d5-b090-b54865a54177 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:44.687269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:44.687917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:44.688202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:44.688472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:44.689306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:44.689618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:44.691068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:44.708647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 656/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Fri Jul 1 19:28:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:44.718448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:44.812989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:44.823461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac592ab1-93c3-4d63-98cc-462afde331d9 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:44.858242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b9400-430d-4cfe-ad04-b640761b8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:44.858890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9400-430d-4cfe-ad04-b640761b8033 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:44.859175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9400-430d-4cfe-ad04-b640761b8033 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:44.859454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9400-430d-4cfe-ad04-b640761b8033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:44.927372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b9400-430d-4cfe-ad04-b640761b8033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:44.928755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b9400-430d-4cfe-ad04-b640761b8033 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:45.019558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:45.032183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 626/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Fri Jul 1 19:28:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 19:28:45.039230 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:45.107179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:45.145131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a350f1-0b9a-4bfe-91c8-41511cdaf685 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:45.183876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:45.184584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:45.184866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:45.185139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:45.196654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:45.198082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 19:28:45.216005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:45.217109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:45.218146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 19:28:45.218146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 19:28:45.218146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 19:28:45.218146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:45.218146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 657/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:45.223159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b9400-430d-4cfe-ad04-b640761b8033 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:45.329903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b9400-430d-4cfe-ad04-b640761b8033 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:45.368720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:45.369373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:45.369654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:45.369930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:45.370797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:45.371328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:45.373513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:45.386617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 627/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Fri Jul 1 19:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:45.393115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:45.511093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350803a-6c01-4d7f-9756-e82d24528654 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:45.526829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:45.551622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:45.552422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:45.552701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:45.552980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:45.559940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:45.561412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 19:28:45.575477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:45.576502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: ERROR keystone.server.flask.application Jul 01 19:28:45.577861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 658/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Fri Jul 1 19:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:45.585631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:45.652250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:45.705427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed871b-0a58-441f-ace4-d66e77cf4d06 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:45.741353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9489001-9502-43d6-b07e-1ad5c84d5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:45.742030 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489001-9502-43d6-b07e-1ad5c84d5793 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:45.742310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489001-9502-43d6-b07e-1ad5c84d5793 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:45.742585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9489001-9502-43d6-b07e-1ad5c84d5793 None admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:45.743405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9489001-9502-43d6-b07e-1ad5c84d5793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:45.743730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9489001-9502-43d6-b07e-1ad5c84d5793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:45.745271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9489001-9502-43d6-b07e-1ad5c84d5793 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:45.757445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 628/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Fri Jul 1 19:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:45.764475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:45.875899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19df46-f323-455c-8eb5-5016f708865e None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:45.910533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2587bc-b3f7-4722-bf67-62e6cf7980fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:45.911170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2587bc-b3f7-4722-bf67-62e6cf7980fa None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:45.911452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2587bc-b3f7-4722-bf67-62e6cf7980fa None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:45.911723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2587bc-b3f7-4722-bf67-62e6cf7980fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:45.912598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2587bc-b3f7-4722-bf67-62e6cf7980fa None admin] RBAC: Adding query filter params (role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441, scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb, user.id=6f6684cfbbc54d568730d44c923770ea) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:45.912939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2587bc-b3f7-4722-bf67-62e6cf7980fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:45.914381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2587bc-b3f7-4722-bf67-62e6cf7980fa None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:45.920401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 659/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Fri Jul 1 19:28:45 2022] GET /identity/v3/role_assignments?user.id=6f6684cfbbc54d568730d44c923770ea&scope.project.id=0c4357b276a7478bac1f9e6086fd8ceb&role.id=4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:47.933771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894744-0660-4b4d-b727-c1c24a8d29df None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:47.934765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894744-0660-4b4d-b727-c1c24a8d29df None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:47.934765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7894744-0660-4b4d-b727-c1c24a8d29df None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:47.936967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 629/1288] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:47.942547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12038a8-dea1-43fe-8c14-01be8568a214 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:47.942990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12038a8-dea1-43fe-8c14-01be8568a214 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:47.943088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12038a8-dea1-43fe-8c14-01be8568a214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:47.962138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d12038a8-dea1-43fe-8c14-01be8568a214 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:47.963337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d12038a8-dea1-43fe-8c14-01be8568a214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:48.005304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:48.045132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 660/1289] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:48.068169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894744-0660-4b4d-b727-c1c24a8d29df None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:48.183011 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7894744-0660-4b4d-b727-c1c24a8d29df None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:48.193691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:48.219216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:48.219999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:48.220268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:48.220535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:48.221180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:48.222602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:48.234989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:48.236249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:48.237574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 630/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:28:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:48.245437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12038a8-dea1-43fe-8c14-01be8568a214 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:48.351878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12038a8-dea1-43fe-8c14-01be8568a214 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:48.387378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752eccb-0f4f-4f4b-b8e1-417c58ae37fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:48.388018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752eccb-0f4f-4f4b-b8e1-417c58ae37fb None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:48.388302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752eccb-0f4f-4f4b-b8e1-417c58ae37fb None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:48.388565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752eccb-0f4f-4f4b-b8e1-417c58ae37fb None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:48.389273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752eccb-0f4f-4f4b-b8e1-417c58ae37fb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:48.389579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752eccb-0f4f-4f4b-b8e1-417c58ae37fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:48.390988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752eccb-0f4f-4f4b-b8e1-417c58ae37fb None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:48.395984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 661/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jul 1 19:28:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:48.402588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:48.518027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cfb02-0e8a-4dcd-bc61-557db9b8d100 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:48.553219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23aa936-b28d-451c-97cc-a665179bc110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:48.553870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23aa936-b28d-451c-97cc-a665179bc110 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:48.554187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23aa936-b28d-451c-97cc-a665179bc110 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:48.554462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23aa936-b28d-451c-97cc-a665179bc110 None admin] PATH_INFO: `/v3/services` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:48.555171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23aa936-b28d-451c-97cc-a665179bc110 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:48.555483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23aa936-b28d-451c-97cc-a665179bc110 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:48.556954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23aa936-b28d-451c-97cc-a665179bc110 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:48.561706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 631/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jul 1 19:28:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:50.553010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8c14c-5a18-4838-a4fa-679048633bc7 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:50.553626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8c14c-5a18-4838-a4fa-679048633bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:50.553626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8c14c-5a18-4838-a4fa-679048633bc7 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:50.554970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 662/1293] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:50.561257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a313-87d7-4007-8191-0a0d043f1c03 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:50.562015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a313-87d7-4007-8191-0a0d043f1c03 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:50.562213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29a313-87d7-4007-8191-0a0d043f1c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:50.584898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-df29a313-87d7-4007-8191-0a0d043f1c03 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:50.586189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-df29a313-87d7-4007-8191-0a0d043f1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:50.618368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:50.658113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 632/1294] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:50.684311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8c14c-5a18-4838-a4fa-679048633bc7 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:50.721063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:50.794548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8c14c-5a18-4838-a4fa-679048633bc7 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:50.833654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6e525-4754-4917-bdfd-7becb45f0f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:50.834718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6e525-4754-4917-bdfd-7becb45f0f72 None admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:50.835010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6e525-4754-4917-bdfd-7becb45f0f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:50.835537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6e525-4754-4917-bdfd-7becb45f0f72 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:50.836408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6e525-4754-4917-bdfd-7becb45f0f72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:50.838164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6e525-4754-4917-bdfd-7becb45f0f72 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:50.854369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 663/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Fri Jul 1 19:28:50 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:28:52.884514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5228-98bd-47f0-a0a1-ecf24eeb63bb None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:52.885463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5228-98bd-47f0-a0a1-ecf24eeb63bb None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:52.885657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5228-98bd-47f0-a0a1-ecf24eeb63bb None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:52.888003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 633/1296] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:52.894626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1fef2-ba06-4236-bdcc-4983bcea7db7 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:52.895352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1fef2-ba06-4236-bdcc-4983bcea7db7 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:52.895514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1fef2-ba06-4236-bdcc-4983bcea7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:52.920596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-62a1fef2-ba06-4236-bdcc-4983bcea7db7 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:52.921778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-62a1fef2-ba06-4236-bdcc-4983bcea7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:53.000906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 664/1297] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:53.024906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5228-98bd-47f0-a0a1-ecf24eeb63bb None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:53.145583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5228-98bd-47f0-a0a1-ecf24eeb63bb None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:53.178657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:53.179453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:53.179731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:53.180003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:53.180660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:53.182094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:53.194435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:53.195583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:53.196611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 634/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:28:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:53.202682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1fef2-ba06-4236-bdcc-4983bcea7db7 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:53.226334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:53.314496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1fef2-ba06-4236-bdcc-4983bcea7db7 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:53.351010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:53.351650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:53.351930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:53.352208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:53.352915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:53.353220 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:53.354643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:53.359990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 665/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jul 1 19:28:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:53.366677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:53.408005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:53.487259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8cfa6-7172-4888-ac64-939741b2f8e5 None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:53.523936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b435e-714b-4309-a79a-13fbdd8a780d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:53.524582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b435e-714b-4309-a79a-13fbdd8a780d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:53.524864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b435e-714b-4309-a79a-13fbdd8a780d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:53.525139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b435e-714b-4309-a79a-13fbdd8a780d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:53.525995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b435e-714b-4309-a79a-13fbdd8a780d None admin] RBAC: Adding query filter params (interface=public, service_id=90019c098bda4ae9aa816b8833d0b845, region_id=RegionOne) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:53.526297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b435e-714b-4309-a79a-13fbdd8a780d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:53.527689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b435e-714b-4309-a79a-13fbdd8a780d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:53.532957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 635/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Fri Jul 1 19:28:53 2022] GET /identity/v3/endpoints?service_id=90019c098bda4ae9aa816b8833d0b845&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:53.538899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:53.635869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:53.670591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6c9cc-4d78-487c-9727-b0048ae226c2 None admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:53.708418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0772a8-e359-4a35-94fd-776579472044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:53.709401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0772a8-e359-4a35-94fd-776579472044 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:53.709685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0772a8-e359-4a35-94fd-776579472044 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:53.709989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0772a8-e359-4a35-94fd-776579472044 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:53.710675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0772a8-e359-4a35-94fd-776579472044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:53.712051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0772a8-e359-4a35-94fd-776579472044 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:53.719042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 666/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Fri Jul 1 19:28:53 2022] GET /identity/v3/services => generated 2191 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:28:55.702007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7f1c-44fe-436b-a9df-f933796681f6 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:55.702899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7f1c-44fe-436b-a9df-f933796681f6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:55.702899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d7f1c-44fe-436b-a9df-f933796681f6 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:55.705105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 636/1302] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:28:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:28:55.711640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b5af2-d68f-46d4-8c23-2d361c855a2b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:55.712320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b5af2-d68f-46d4-8c23-2d361c855a2b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:55.712465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b5af2-d68f-46d4-8c23-2d361c855a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:55.737866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-673b5af2-d68f-46d4-8c23-2d361c855a2b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:28:55.739090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-673b5af2-d68f-46d4-8c23-2d361c855a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:28:55.811040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 667/1303] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:28:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 19:28:55.838776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d7f1c-44fe-436b-a9df-f933796681f6 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:55.942406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:55.950689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d7f1c-44fe-436b-a9df-f933796681f6 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:55.986012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:55.986743 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:55.987022 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:55.987294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:55.987942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:55.989306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 19:28:56.001424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 19:28:56.002657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application with Lock( Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self._enter() Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application return self.creator() Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application created_value = creator( Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: ERROR keystone.server.flask.application Jul 01 19:28:56.003502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 637/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Fri Jul 1 19:28:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 19:28:56.009032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b5af2-d68f-46d4-8c23-2d361c855a2b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:56.091683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:28:56.115668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b5af2-d68f-46d4-8c23-2d361c855a2b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:56.154167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09e9d7-f157-4996-bd23-266d75f3c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:56.154818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e9d7-f157-4996-bd23-266d75f3c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:56.155094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e9d7-f157-4996-bd23-266d75f3c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:56.155368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09e9d7-f157-4996-bd23-266d75f3c6a0 None admin] PATH_INFO: `/v3/services` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:56.156078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09e9d7-f157-4996-bd23-266d75f3c6a0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:28:56.156388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09e9d7-f157-4996-bd23-266d75f3c6a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:56.157743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09e9d7-f157-4996-bd23-266d75f3c6a0 None admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:56.163069 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 668/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Fri Jul 1 19:28:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:28:56.172241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:28:56.283677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31e9ff-2563-40e5-bf5e-fade0cfe713d None admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:28:56.320239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e47fff4-ca7c-47aa-9cbe-04b543b0bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:28:56.320883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47fff4-ca7c-47aa-9cbe-04b543b0bb24 None admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:28:56.321159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47fff4-ca7c-47aa-9cbe-04b543b0bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:28:56.321434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47fff4-ca7c-47aa-9cbe-04b543b0bb24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:28:56.322201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47fff4-ca7c-47aa-9cbe-04b543b0bb24 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:28:56.323586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e47fff4-ca7c-47aa-9cbe-04b543b0bb24 None admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:28:56.344726 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 638/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Fri Jul 1 19:28:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:29:06.159898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=30 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:29:06.339734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:29:59.053070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e0c69-4dbb-451c-b12a-4a1ff90be17a None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:59.053602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e0c69-4dbb-451c-b12a-4a1ff90be17a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:59.053602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e0c69-4dbb-451c-b12a-4a1ff90be17a None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:59.060896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c11fa-e0e4-41f9-8dd7-ed5957028386 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:59.060896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c11fa-e0e4-41f9-8dd7-ed5957028386 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:59.061337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c11fa-e0e4-41f9-8dd7-ed5957028386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:59.064435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 669/1307] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:29:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:59.152438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-161c11fa-e0e4-41f9-8dd7-ed5957028386 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:59.153776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-161c11fa-e0e4-41f9-8dd7-ed5957028386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:59.394103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 639/1308] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:29:59.457035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f4a3-d559-45f5-97bd-35bd18459d4c None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:59.457318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f4a3-d559-45f5-97bd-35bd18459d4c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:59.457595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912f4a3-d559-45f5-97bd-35bd18459d4c None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:59.460098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 670/1309] 10.222.0.61 () {54 vars in 964 bytes} [Fri Jul 1 19:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:29:59.466343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85de967-ef19-40c7-8f2e-5b88c4e5683e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:29:59.466641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85de967-ef19-40c7-8f2e-5b88c4e5683e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:29:59.466930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85de967-ef19-40c7-8f2e-5b88c4e5683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:29:59.634756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d85de967-ef19-40c7-8f2e-5b88c4e5683e None None] MFA Rules not processed for user `9fcc425392664c17b72fb4655f8fb7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:29:59.636186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d85de967-ef19-40c7-8f2e-5b88c4e5683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:59.688635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:29:59.800969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 640/1310] 10.222.0.61 () {58 vars in 1061 bytes} [Fri Jul 1 19:29:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:29:59.809825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912f4a3-d559-45f5-97bd-35bd18459d4c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:29:59.811661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f912f4a3-d559-45f5-97bd-35bd18459d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:29:59.944917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912f4a3-d559-45f5-97bd-35bd18459d4c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:00.025910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed109832-411d-4750-80d8-b67b01901e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:00.026688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109832-411d-4750-80d8-b67b01901e99 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:00.027031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109832-411d-4750-80d8-b67b01901e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:00.027368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed109832-411d-4750-80d8-b67b01901e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:00.029234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ed109832-411d-4750-80d8-b67b01901e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:00.096109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:00.154292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed109832-411d-4750-80d8-b67b01901e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:00.155781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed109832-411d-4750-80d8-b67b01901e99 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:00.190382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 671/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:02.526380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474424c-db0a-4767-a75d-2e991b51a6b9 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:02.526967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474424c-db0a-4767-a75d-2e991b51a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:02.526967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2474424c-db0a-4767-a75d-2e991b51a6b9 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:02.528293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 641/1312] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:02.533809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f94c-4a0b-4c65-b49b-e7cfbbbcb9ff None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:02.534331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f94c-4a0b-4c65-b49b-e7cfbbbcb9ff None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:02.534610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18f94c-4a0b-4c65-b49b-e7cfbbbcb9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:02.624933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-fc18f94c-4a0b-4c65-b49b-e7cfbbbcb9ff None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:02.626184 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fc18f94c-4a0b-4c65-b49b-e7cfbbbcb9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:02.748049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 672/1313] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:02.809381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bcba-cbf4-4559-b7f9-223eb19c7661 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:02.809646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bcba-cbf4-4559-b7f9-223eb19c7661 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:02.809988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2bcba-cbf4-4559-b7f9-223eb19c7661 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:02.811406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 642/1314] 10.222.0.61 () {54 vars in 964 bytes} [Fri Jul 1 19:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:02.818067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736a3c-e89e-427a-8304-ea2c3fa6a36c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:02.818354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736a3c-e89e-427a-8304-ea2c3fa6a36c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:02.818659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd736a3c-e89e-427a-8304-ea2c3fa6a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:02.829484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:02.898772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-cd736a3c-e89e-427a-8304-ea2c3fa6a36c None None] MFA Rules not processed for user `9fcc425392664c17b72fb4655f8fb7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:02.900013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cd736a3c-e89e-427a-8304-ea2c3fa6a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:02.988633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 673/1315] 10.222.0.61 () {58 vars in 1061 bytes} [Fri Jul 1 19:30:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:02.999298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2bcba-cbf4-4559-b7f9-223eb19c7661 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:03.000852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f4e2bcba-cbf4-4559-b7f9-223eb19c7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:03.120553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2bcba-cbf4-4559-b7f9-223eb19c7661 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:03.206995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:03.212205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a5f45-a016-4dff-b74c-ab5aaa25dcfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:03.213557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a5f45-a016-4dff-b74c-ab5aaa25dcfb service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:03.214289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a5f45-a016-4dff-b74c-ab5aaa25dcfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:03.214670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a5f45-a016-4dff-b74c-ab5aaa25dcfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:03.217380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4b9a5f45-a016-4dff-b74c-ab5aaa25dcfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:03.345692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a5f45-a016-4dff-b74c-ab5aaa25dcfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:03.347093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a5f45-a016-4dff-b74c-ab5aaa25dcfb service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:03.368048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 643/1316] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:05.929424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316f99-6f2b-4198-ab39-6edf85baf6b4 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:05.930335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316f99-6f2b-4198-ab39-6edf85baf6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:05.930426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13316f99-6f2b-4198-ab39-6edf85baf6b4 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:05.932362 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 674/1317] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:05.938935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2869ad-9ae9-4cce-8e2d-df8bf87a27f5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:05.939644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2869ad-9ae9-4cce-8e2d-df8bf87a27f5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:05.939914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2869ad-9ae9-4cce-8e2d-df8bf87a27f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:06.015236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7e2869ad-9ae9-4cce-8e2d-df8bf87a27f5 None None] MFA Rules not processed for user `bfe3b92c2dc6441793fd4e5a64a8a280`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:06.016501 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7e2869ad-9ae9-4cce-8e2d-df8bf87a27f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:06.070663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:06.120576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 644/1318] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:06.161732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316f99-6f2b-4198-ab39-6edf85baf6b4 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:06.164132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-13316f99-6f2b-4198-ab39-6edf85baf6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:06.273631 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13316f99-6f2b-4198-ab39-6edf85baf6b4 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:06.276350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:06.362146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921af0e-c67d-4382-8791-d0961ce4e176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:06.362801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921af0e-c67d-4382-8791-d0961ce4e176 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:06.363086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921af0e-c67d-4382-8791-d0961ce4e176 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:06.363362 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921af0e-c67d-4382-8791-d0961ce4e176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:06.365035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1921af0e-c67d-4382-8791-d0961ce4e176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:06.484094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921af0e-c67d-4382-8791-d0961ce4e176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:06.485553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921af0e-c67d-4382-8791-d0961ce4e176 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:06.508976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 675/1319] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:09.111545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2981d-e615-469b-811b-93fff8603bcf None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:09.112049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2981d-e615-469b-811b-93fff8603bcf None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:09.112049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2981d-e615-469b-811b-93fff8603bcf None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:09.113499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 645/1320] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:09.118866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8526-370c-4d9d-8aa4-162b65af6801 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:09.119323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8526-370c-4d9d-8aa4-162b65af6801 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:09.119414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f8526-370c-4d9d-8aa4-162b65af6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:09.159682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:09.186358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b10f8526-370c-4d9d-8aa4-162b65af6801 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:09.187602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b10f8526-370c-4d9d-8aa4-162b65af6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:09.290663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 676/1321] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:09.343958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2981d-e615-469b-811b-93fff8603bcf None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:09.346547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-aac2981d-e615-469b-811b-93fff8603bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:09.460809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2981d-e615-469b-811b-93fff8603bcf None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:09.536004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04f520-b0fd-4147-8dda-651de6d4c3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:09.536662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f520-b0fd-4147-8dda-651de6d4c3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:09.536940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f520-b0fd-4147-8dda-651de6d4c3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:09.537213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04f520-b0fd-4147-8dda-651de6d4c3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:09.538979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ca04f520-b0fd-4147-8dda-651de6d4c3e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:09.547071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:09.655341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04f520-b0fd-4147-8dda-651de6d4c3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:09.656783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04f520-b0fd-4147-8dda-651de6d4c3e6 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:09.674991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 646/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:12.377420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0c61-e435-4f27-ab91-81898d6589e4 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:12.377993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0c61-e435-4f27-ab91-81898d6589e4 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:12.378310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0c61-e435-4f27-ab91-81898d6589e4 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:12.380340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 677/1323] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:12.386094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90309-3eec-4fa7-9f65-c8deb35ec64c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:12.386559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90309-3eec-4fa7-9f65-c8deb35ec64c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:12.386671 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba90309-3eec-4fa7-9f65-c8deb35ec64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:12.454168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5ba90309-3eec-4fa7-9f65-c8deb35ec64c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:12.455408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5ba90309-3eec-4fa7-9f65-c8deb35ec64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:12.523772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:12.569086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 647/1324] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:12.605315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0c61-e435-4f27-ab91-81898d6589e4 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:12.606975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-84bd0c61-e435-4f27-ab91-81898d6589e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:12.735466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0c61-e435-4f27-ab91-81898d6589e4 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:12.748248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:12.811675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f3570-cec3-453d-a24d-f737bea88243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:12.812475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3570-cec3-453d-a24d-f737bea88243 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:12.812851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3570-cec3-453d-a24d-f737bea88243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:12.813214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f3570-cec3-453d-a24d-f737bea88243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:12.815232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2c2f3570-cec3-453d-a24d-f737bea88243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:12.929256 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3570-cec3-453d-a24d-f737bea88243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:12.930688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f3570-cec3-453d-a24d-f737bea88243 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:12.964770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 678/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:15.053931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478c390-7d60-47d2-b66d-6bcd1d16b0d0 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:15.054518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478c390-7d60-47d2-b66d-6bcd1d16b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:15.054518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478c390-7d60-47d2-b66d-6bcd1d16b0d0 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:15.056543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 648/1326] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:15.061252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95895b1b-d082-48af-9ede-4396cd9995a3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:15.061644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95895b1b-d082-48af-9ede-4396cd9995a3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:15.061782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95895b1b-d082-48af-9ede-4396cd9995a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:15.112160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:15.131225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-95895b1b-d082-48af-9ede-4396cd9995a3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:15.132430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-95895b1b-d082-48af-9ede-4396cd9995a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:15.235601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 679/1327] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:15.271258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478c390-7d60-47d2-b66d-6bcd1d16b0d0 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:15.272914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4478c390-7d60-47d2-b66d-6bcd1d16b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:15.383649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478c390-7d60-47d2-b66d-6bcd1d16b0d0 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:15.465883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df8e34-abeb-4eda-bd34-b8ce90384af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:15.466640 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8e34-abeb-4eda-bd34-b8ce90384af6 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:15.466918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8e34-abeb-4eda-bd34-b8ce90384af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:15.467190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8e34-abeb-4eda-bd34-b8ce90384af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:15.468804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-32df8e34-abeb-4eda-bd34-b8ce90384af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:15.485365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:15.578984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df8e34-abeb-4eda-bd34-b8ce90384af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:15.580612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df8e34-abeb-4eda-bd34-b8ce90384af6 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:15.604911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 649/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:17.702705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737628-243f-49a3-b816-b7ab094c1196 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:17.703308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737628-243f-49a3-b816-b7ab094c1196 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:17.703308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80737628-243f-49a3-b816-b7ab094c1196 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:17.704799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 680/1329] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:17.710866 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190cc04-95bc-4f48-9bc3-d1f4c2f12d1d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:17.711386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190cc04-95bc-4f48-9bc3-d1f4c2f12d1d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:17.711386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190cc04-95bc-4f48-9bc3-d1f4c2f12d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:17.778864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-9190cc04-95bc-4f48-9bc3-d1f4c2f12d1d None None] MFA Rules not processed for user `bfe3b92c2dc6441793fd4e5a64a8a280`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:17.780038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9190cc04-95bc-4f48-9bc3-d1f4c2f12d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:17.852389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:17.886456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 650/1330] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:30:17.924132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737628-243f-49a3-b816-b7ab094c1196 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:17.925662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-80737628-243f-49a3-b816-b7ab094c1196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:18.040774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80737628-243f-49a3-b816-b7ab094c1196 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:18.063803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:18.118862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba74c0-1cba-4cfa-bf14-c319bd4a2874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:18.119510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba74c0-1cba-4cfa-bf14-c319bd4a2874 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:18.119790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba74c0-1cba-4cfa-bf14-c319bd4a2874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:18.120064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba74c0-1cba-4cfa-bf14-c319bd4a2874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:18.121716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-28ba74c0-1cba-4cfa-bf14-c319bd4a2874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:18.260043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba74c0-1cba-4cfa-bf14-c319bd4a2874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:18.261510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba74c0-1cba-4cfa-bf14-c319bd4a2874 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:18.289191 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 681/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:20.560092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f2f6-534c-45da-be41-28fd9055e0e7 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:20.560652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f2f6-534c-45da-be41-28fd9055e0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:20.560652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4f2f6-534c-45da-be41-28fd9055e0e7 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:20.562080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 651/1332] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:20.567534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646372-d94a-48fa-924b-ed51368c5dba None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:20.567987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646372-d94a-48fa-924b-ed51368c5dba None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:20.568091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646372-d94a-48fa-924b-ed51368c5dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:20.645779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:20.648903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-28646372-d94a-48fa-924b-ed51368c5dba None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:20.652131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-28646372-d94a-48fa-924b-ed51368c5dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:20.754134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 682/1333] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:20.792896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4f2f6-534c-45da-be41-28fd9055e0e7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:20.794510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-13c4f2f6-534c-45da-be41-28fd9055e0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:20.909748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4f2f6-534c-45da-be41-28fd9055e0e7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:20.992911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c881136-9615-4437-8592-bb7cd349a695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:20.993806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881136-9615-4437-8592-bb7cd349a695 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:20.994227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881136-9615-4437-8592-bb7cd349a695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:20.994570 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c881136-9615-4437-8592-bb7cd349a695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:20.997183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7c881136-9615-4437-8592-bb7cd349a695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:21.027244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:21.120923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c881136-9615-4437-8592-bb7cd349a695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:21.122445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c881136-9615-4437-8592-bb7cd349a695 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:21.142430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 652/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:30:23.211316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f51d9-ecbd-47d4-8349-6177bd884d1d None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:23.211891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f51d9-ecbd-47d4-8349-6177bd884d1d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:23.211891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f51d9-ecbd-47d4-8349-6177bd884d1d None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:23.213314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 683/1335] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:23.219415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15971f8a-a88e-42ca-b11a-c7830b5bf2b9 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:23.219821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15971f8a-a88e-42ca-b11a-c7830b5bf2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:23.219977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15971f8a-a88e-42ca-b11a-c7830b5bf2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:23.296423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-15971f8a-a88e-42ca-b11a-c7830b5bf2b9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:23.297625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-15971f8a-a88e-42ca-b11a-c7830b5bf2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:23.378848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:23.402527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 653/1336] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:23.442825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f51d9-ecbd-47d4-8349-6177bd884d1d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:23.445176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-368f51d9-ecbd-47d4-8349-6177bd884d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:23.562714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f51d9-ecbd-47d4-8349-6177bd884d1d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:23.598694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:23.644086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212e24-e918-4777-a370-db83865e3744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:23.644736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212e24-e918-4777-a370-db83865e3744 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:23.645013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212e24-e918-4777-a370-db83865e3744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:23.645288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212e24-e918-4777-a370-db83865e3744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:23.646951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-91212e24-e918-4777-a370-db83865e3744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:23.763346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212e24-e918-4777-a370-db83865e3744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:23.764783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212e24-e918-4777-a370-db83865e3744 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:23.784655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 684/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:26.170952 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a52b2-504f-458b-8389-875e65725a00 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:26.171507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a52b2-504f-458b-8389-875e65725a00 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:26.171507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a52b2-504f-458b-8389-875e65725a00 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:26.172921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 654/1338] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:26.179045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567404-cc83-407b-89d9-fd4e263dd533 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:26.179500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567404-cc83-407b-89d9-fd4e263dd533 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:26.179656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567404-cc83-407b-89d9-fd4e263dd533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:26.247024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-9a567404-cc83-407b-89d9-fd4e263dd533 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:26.248278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9a567404-cc83-407b-89d9-fd4e263dd533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:26.256945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:26.355700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 685/1339] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:30:26.391580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a52b2-504f-458b-8389-875e65725a00 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:26.393116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6e4a52b2-504f-458b-8389-875e65725a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:26.509104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a52b2-504f-458b-8389-875e65725a00 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:26.590251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da811c9-fe15-4d82-b875-5487a076f1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:26.590898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da811c9-fe15-4d82-b875-5487a076f1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:26.591176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da811c9-fe15-4d82-b875-5487a076f1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:26.591446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da811c9-fe15-4d82-b875-5487a076f1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:26.593068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0da811c9-fe15-4d82-b875-5487a076f1a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:26.630190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:26.716455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da811c9-fe15-4d82-b875-5487a076f1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:26.717904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da811c9-fe15-4d82-b875-5487a076f1a0 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:26.739049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 655/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:31.111745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12020a-ad0a-45c7-8ad6-1a7e6617c894 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:31.112223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12020a-ad0a-45c7-8ad6-1a7e6617c894 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:31.112487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12020a-ad0a-45c7-8ad6-1a7e6617c894 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:31.113973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 686/1341] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:31.119939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fd20-7bc3-44af-b796-61c552be0601 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:31.120415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fd20-7bc3-44af-b796-61c552be0601 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:31.120510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fd20-7bc3-44af-b796-61c552be0601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:31.210402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-46d6fd20-7bc3-44af-b796-61c552be0601 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:31.211833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-46d6fd20-7bc3-44af-b796-61c552be0601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:31.317208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:31.332694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 656/1342] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:30:31.372261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12020a-ad0a-45c7-8ad6-1a7e6617c894 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:31.374584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3f12020a-ad0a-45c7-8ad6-1a7e6617c894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:31.501010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12020a-ad0a-45c7-8ad6-1a7e6617c894 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:31.505148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f94bb-2410-499b-84a2-dc76d41d5e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:31.506190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f94bb-2410-499b-84a2-dc76d41d5e5f service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:31.506405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f94bb-2410-499b-84a2-dc76d41d5e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:31.506630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f94bb-2410-499b-84a2-dc76d41d5e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:31.516953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f94bb-2410-499b-84a2-dc76d41d5e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:31.518451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f94bb-2410-499b-84a2-dc76d41d5e5f service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:31.528429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 687/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:34.243386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d471-4b95-4bfc-b9e8-1c1b4c043f1b None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:34.243928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d471-4b95-4bfc-b9e8-1c1b4c043f1b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:34.243928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7d471-4b95-4bfc-b9e8-1c1b4c043f1b None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:34.245365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 657/1344] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:34.250902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea736-7a72-4d5c-8d04-92a6f39f2efa None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:34.251358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea736-7a72-4d5c-8d04-92a6f39f2efa None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:34.251442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ea736-7a72-4d5c-8d04-92a6f39f2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:34.282257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-3e4ea736-7a72-4d5c-8d04-92a6f39f2efa None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:34.283538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3e4ea736-7a72-4d5c-8d04-92a6f39f2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:34.314433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:34.370180 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 688/1345] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:34.404958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7d471-4b95-4bfc-b9e8-1c1b4c043f1b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:34.416380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7d471-4b95-4bfc-b9e8-1c1b4c043f1b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:34.420154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd567be-642e-43c2-a5c2-850c5e2a34aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:34.420813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd567be-642e-43c2-a5c2-850c5e2a34aa service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:34.421101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd567be-642e-43c2-a5c2-850c5e2a34aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:34.421375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd567be-642e-43c2-a5c2-850c5e2a34aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:34.431245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd567be-642e-43c2-a5c2-850c5e2a34aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:34.432690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd567be-642e-43c2-a5c2-850c5e2a34aa service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:34.447557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 658/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:38.456318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514d0f-3cc1-487b-a06c-bbb35c5dc5e5 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:38.456839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514d0f-3cc1-487b-a06c-bbb35c5dc5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:38.456839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22514d0f-3cc1-487b-a06c-bbb35c5dc5e5 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:38.458463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 689/1347] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:38.463963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308ccc-5e6f-4267-b6f1-bb7b7645c043 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:38.464422 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308ccc-5e6f-4267-b6f1-bb7b7645c043 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:38.464506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308ccc-5e6f-4267-b6f1-bb7b7645c043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:38.483941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b5308ccc-5e6f-4267-b6f1-bb7b7645c043 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:38.485147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b5308ccc-5e6f-4267-b6f1-bb7b7645c043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:38.495126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 659/1348] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:38.532657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22514d0f-3cc1-487b-a06c-bbb35c5dc5e5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:38.534619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-22514d0f-3cc1-487b-a06c-bbb35c5dc5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:38.547595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22514d0f-3cc1-487b-a06c-bbb35c5dc5e5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:38.550979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef1fcb-9a48-4f70-922d-2f47fedc9497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:38.551624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1fcb-9a48-4f70-922d-2f47fedc9497 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:38.551878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1fcb-9a48-4f70-922d-2f47fedc9497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:38.552173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef1fcb-9a48-4f70-922d-2f47fedc9497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:38.561615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef1fcb-9a48-4f70-922d-2f47fedc9497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:38.563087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef1fcb-9a48-4f70-922d-2f47fedc9497 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:38.572763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 690/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:43.550983 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f5ff-7264-42c3-ab37-d3e91b811ab9 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:43.551520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f5ff-7264-42c3-ab37-d3e91b811ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:43.551871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f5ff-7264-42c3-ab37-d3e91b811ab9 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:43.555260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 660/1350] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:30:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:43.561683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319c1c-0f59-4a55-924d-7f0b00c5e790 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:43.562133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319c1c-0f59-4a55-924d-7f0b00c5e790 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:43.562558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67319c1c-0f59-4a55-924d-7f0b00c5e790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:43.671849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-67319c1c-0f59-4a55-924d-7f0b00c5e790 None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:43.673269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-67319c1c-0f59-4a55-924d-7f0b00c5e790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:43.765156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 691/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:47.828740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a86fce-873a-49d4-9ebb-e64710eaffdf None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:47.829787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a86fce-873a-49d4-9ebb-e64710eaffdf None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:47.830304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a86fce-873a-49d4-9ebb-e64710eaffdf None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:47.832036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 661/1352] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:47.838019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d3c4-b2ce-4656-b130-3b75d675ba7c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:47.838429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d3c4-b2ce-4656-b130-3b75d675ba7c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:47.838574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4d3c4-b2ce-4656-b130-3b75d675ba7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:47.858952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ccc4d3c4-b2ce-4656-b130-3b75d675ba7c None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:47.860183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ccc4d3c4-b2ce-4656-b130-3b75d675ba7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:47.868897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 692/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:30:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:48.478593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=13 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:49.409249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8437f-95b4-44ad-bfb6-ae5b2c111734 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:49.409984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8437f-95b4-44ad-bfb6-ae5b2c111734 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:49.409984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8437f-95b4-44ad-bfb6-ae5b2c111734 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:49.411153 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 662/1354] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:49.416266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559efe-da7d-4b00-8481-5abcb536016a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:49.416735 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559efe-da7d-4b00-8481-5abcb536016a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:49.416845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559efe-da7d-4b00-8481-5abcb536016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:49.435211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-52559efe-da7d-4b00-8481-5abcb536016a None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:49.436418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-52559efe-da7d-4b00-8481-5abcb536016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:49.445012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 693/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:30:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:53.037711 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6394-ea0b-4060-a4f2-ffca6225e6e4 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:53.038564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6394-ea0b-4060-a4f2-ffca6225e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:53.039003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6394-ea0b-4060-a4f2-ffca6225e6e4 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:53.043171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 663/1356] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:53.049295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d0b8-6e72-403c-9ba4-c89ef7678bf2 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:53.050182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d0b8-6e72-403c-9ba4-c89ef7678bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:53.050607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836d0b8-6e72-403c-9ba4-c89ef7678bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:53.075106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e836d0b8-6e72-403c-9ba4-c89ef7678bf2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:53.076377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e836d0b8-6e72-403c-9ba4-c89ef7678bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:53.084753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 694/1357] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:53.141332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fcc95-1433-4f99-b370-7c8e3d870fe1 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:53.142000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fcc95-1433-4f99-b370-7c8e3d870fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:53.142433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fcc95-1433-4f99-b370-7c8e3d870fe1 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:53.144037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 664/1358] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jul 1 19:30:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:53.153647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fdb7-875b-48d8-bea0-74f7d0baede9 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:53.155077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fdb7-875b-48d8-bea0-74f7d0baede9 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:53.155767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473fdb7-875b-48d8-bea0-74f7d0baede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:53.203737 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:30:53.212238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4473fdb7-875b-48d8-bea0-74f7d0baede9 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:53.213440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4473fdb7-875b-48d8-bea0-74f7d0baede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:53.299819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 695/1359] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jul 1 19:30:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:53.307504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fcc95-1433-4f99-b370-7c8e3d870fe1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:53.322831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fcc95-1433-4f99-b370-7c8e3d870fe1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:53.328471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dc813-3600-4c4a-80c9-6d9eb2f25e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:53.329112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc813-3600-4c4a-80c9-6d9eb2f25e18 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:53.329390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc813-3600-4c4a-80c9-6d9eb2f25e18 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:53.329664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dc813-3600-4c4a-80c9-6d9eb2f25e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:53.339109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dc813-3600-4c4a-80c9-6d9eb2f25e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:53.340748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0dc813-3600-4c4a-80c9-6d9eb2f25e18 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:53.351113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 665/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:55.556270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339f4d-652d-42d0-836b-66e1b65da919 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.556822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339f4d-652d-42d0-836b-66e1b65da919 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.557061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c339f4d-652d-42d0-836b-66e1b65da919 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.558753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 696/1361] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:55.563990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1537-2bf4-4746-82a8-102f0dfc6b8d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.564432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1537-2bf4-4746-82a8-102f0dfc6b8d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.564514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1537-2bf4-4746-82a8-102f0dfc6b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.582770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-634a1537-2bf4-4746-82a8-102f0dfc6b8d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:55.584322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-634a1537-2bf4-4746-82a8-102f0dfc6b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:55.592958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 666/1362] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:55.637998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c339f4d-652d-42d0-836b-66e1b65da919 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:55.653427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c339f4d-652d-42d0-836b-66e1b65da919 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:55.659427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ac322-edc7-42a6-a6fe-6a001c98eebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:55.660172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac322-edc7-42a6-a6fe-6a001c98eebc service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:55.660546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac322-edc7-42a6-a6fe-6a001c98eebc service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:55.660920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ac322-edc7-42a6-a6fe-6a001c98eebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:55.670445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ac322-edc7-42a6-a6fe-6a001c98eebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:55.675973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ac322-edc7-42a6-a6fe-6a001c98eebc service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:55.687206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 697/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:30:58.053575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc650a4-836c-4a0f-a84a-ac6a679191f6 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:58.054658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc650a4-836c-4a0f-a84a-ac6a679191f6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:58.055162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc650a4-836c-4a0f-a84a-ac6a679191f6 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:58.056764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 667/1364] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:58.062742 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920072f-2d7f-4298-a122-da0a78414ddf None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:58.070701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920072f-2d7f-4298-a122-da0a78414ddf None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:58.071274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920072f-2d7f-4298-a122-da0a78414ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:58.094870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8920072f-2d7f-4298-a122-da0a78414ddf None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:58.096583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8920072f-2d7f-4298-a122-da0a78414ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:58.105379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 698/1365] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:58.151416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a929b-2c4a-4b0a-b7b8-585d64c1a1e4 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:58.151737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a929b-2c4a-4b0a-b7b8-585d64c1a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:58.152020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a929b-2c4a-4b0a-b7b8-585d64c1a1e4 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:58.153462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 668/1366] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jul 1 19:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:30:58.159206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be57d6-f5c1-45d4-9359-d0187a36f1f9 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:58.159497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be57d6-f5c1-45d4-9359-d0187a36f1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:58.159784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be57d6-f5c1-45d4-9359-d0187a36f1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:58.181219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b2be57d6-f5c1-45d4-9359-d0187a36f1f9 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:30:58.182493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b2be57d6-f5c1-45d4-9359-d0187a36f1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:30:58.193325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 699/1367] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jul 1 19:30:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:30:58.201332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a929b-2c4a-4b0a-b7b8-585d64c1a1e4 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:30:58.217081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a929b-2c4a-4b0a-b7b8-585d64c1a1e4 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:30:58.223276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61433e72-6f11-44c3-8c6c-af6d036215b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:30:58.223987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433e72-6f11-44c3-8c6c-af6d036215b3 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:30:58.224339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433e72-6f11-44c3-8c6c-af6d036215b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:30:58.224684 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61433e72-6f11-44c3-8c6c-af6d036215b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:30:58.233552 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61433e72-6f11-44c3-8c6c-af6d036215b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:30:58.235317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61433e72-6f11-44c3-8c6c-af6d036215b3 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:30:58.252748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 669/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:31:00.340162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178e5c-fd95-4c63-b37e-077eee7087fe None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:00.340740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178e5c-fd95-4c63-b37e-077eee7087fe None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:00.340740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13178e5c-fd95-4c63-b37e-077eee7087fe None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:00.342592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 700/1369] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:00.348215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ca88-9a93-4586-8c3f-a1a7d3b3f70f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:00.348800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ca88-9a93-4586-8c3f-a1a7d3b3f70f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:00.348940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ca88-9a93-4586-8c3f-a1a7d3b3f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:00.367970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1d05ca88-9a93-4586-8c3f-a1a7d3b3f70f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:00.369297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1d05ca88-9a93-4586-8c3f-a1a7d3b3f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:00.377848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 670/1370] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:00.422293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178e5c-fd95-4c63-b37e-077eee7087fe None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:00.436971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13178e5c-fd95-4c63-b37e-077eee7087fe None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:00.442386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06f206-a807-4290-bea2-4532c5581213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:00.443089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f206-a807-4290-bea2-4532c5581213 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:00.443461 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f206-a807-4290-bea2-4532c5581213 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:00.443897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f206-a807-4290-bea2-4532c5581213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:00.452666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06f206-a807-4290-bea2-4532c5581213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:00.454390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06f206-a807-4290-bea2-4532c5581213 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:00.464437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 701/1371] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:01.082565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9073-db69-4cf9-93a4-7f335d426300 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:01.083084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9073-db69-4cf9-93a4-7f335d426300 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:01.083868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe9073-db69-4cf9-93a4-7f335d426300 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:01.085283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 671/1372] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:01.090690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd822-e786-492d-8d85-2a08afe49601 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:01.091194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd822-e786-492d-8d85-2a08afe49601 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:01.091519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1afd822-e786-492d-8d85-2a08afe49601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:01.110127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d1afd822-e786-492d-8d85-2a08afe49601 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:01.111813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d1afd822-e786-492d-8d85-2a08afe49601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:01.126740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 702/1373] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:01.481383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e7d8-f828-4afd-94e3-aa7940c5645c None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:01.482345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e7d8-f828-4afd-94e3-aa7940c5645c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:01.482810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e7d8-f828-4afd-94e3-aa7940c5645c None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:01.484399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 672/1374] 10.222.0.61 () {54 vars in 963 bytes} [Fri Jul 1 19:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:31:01.489558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5b31-01b2-4c25-a620-7fd7f871c016 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:01.490326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5b31-01b2-4c25-a620-7fd7f871c016 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:01.490783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc5b31-01b2-4c25-a620-7fd7f871c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:01.541194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6fcc5b31-01b2-4c25-a620-7fd7f871c016 None None] MFA Rules not processed for user `bfbcf52f970e475c8d7f91d373949ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:01.542755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6fcc5b31-01b2-4c25-a620-7fd7f871c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:01.610259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 703/1375] 10.222.0.61 () {58 vars in 1060 bytes} [Fri Jul 1 19:31:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:01.617611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9e7d8-f828-4afd-94e3-aa7940c5645c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:01.629029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9e7d8-f828-4afd-94e3-aa7940c5645c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:01.632823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46f78b-4ece-479d-af0d-e3938f20b26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:01.633707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46f78b-4ece-479d-af0d-e3938f20b26d service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:01.634189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46f78b-4ece-479d-af0d-e3938f20b26d service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:01.634629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46f78b-4ece-479d-af0d-e3938f20b26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:01.644587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46f78b-4ece-479d-af0d-e3938f20b26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:01.646287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46f78b-4ece-479d-af0d-e3938f20b26d service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:01.657771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 673/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:02.524504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496c17-5469-48ac-a63f-939b2c70f03c None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:02.525120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496c17-5469-48ac-a63f-939b2c70f03c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:02.525120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9496c17-5469-48ac-a63f-939b2c70f03c None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:02.526475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 704/1377] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:02.531950 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec9f9-c428-4059-883a-3bca8c70ba35 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:02.532373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec9f9-c428-4059-883a-3bca8c70ba35 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:02.532475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ec9f9-c428-4059-883a-3bca8c70ba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:02.550517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1d8ec9f9-c428-4059-883a-3bca8c70ba35 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:02.551710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1d8ec9f9-c428-4059-883a-3bca8c70ba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:02.560024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 674/1378] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:02.603982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496c17-5469-48ac-a63f-939b2c70f03c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:02.619109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9496c17-5469-48ac-a63f-939b2c70f03c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:02.625218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611e13b-bcae-4959-a39c-a9f0e92bc5ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:02.625839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611e13b-bcae-4959-a39c-a9f0e92bc5ff service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:02.626152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611e13b-bcae-4959-a39c-a9f0e92bc5ff service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:02.626436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611e13b-bcae-4959-a39c-a9f0e92bc5ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:02.635132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611e13b-bcae-4959-a39c-a9f0e92bc5ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:02.636771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611e13b-bcae-4959-a39c-a9f0e92bc5ff service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:02.640804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:31:02.647903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 705/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:04.743844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5510e73-71f6-4e24-ae30-f1180e88bc21 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:04.744377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5510e73-71f6-4e24-ae30-f1180e88bc21 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:04.744377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5510e73-71f6-4e24-ae30-f1180e88bc21 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:04.745753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 675/1380] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:04.752497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf14ef-90bd-46d3-aa19-2293d6e474d0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:04.753066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf14ef-90bd-46d3-aa19-2293d6e474d0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:04.753066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf14ef-90bd-46d3-aa19-2293d6e474d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:04.772456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-61bf14ef-90bd-46d3-aa19-2293d6e474d0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:04.773695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-61bf14ef-90bd-46d3-aa19-2293d6e474d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:04.784306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 706/1381] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:04.836389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5510e73-71f6-4e24-ae30-f1180e88bc21 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:04.852067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5510e73-71f6-4e24-ae30-f1180e88bc21 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:04.857835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752151d3-c284-49f3-90bf-93a0a8081a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:04.858580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752151d3-c284-49f3-90bf-93a0a8081a51 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:04.858916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752151d3-c284-49f3-90bf-93a0a8081a51 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:04.859255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752151d3-c284-49f3-90bf-93a0a8081a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:04.868157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752151d3-c284-49f3-90bf-93a0a8081a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:04.869833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752151d3-c284-49f3-90bf-93a0a8081a51 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:04.879737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 676/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:06.992435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a694d5-4ca4-49af-9ef7-9b8aa09136fe None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:06.993039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a694d5-4ca4-49af-9ef7-9b8aa09136fe None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:06.993039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a694d5-4ca4-49af-9ef7-9b8aa09136fe None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:06.994355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 707/1383] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:06.999910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76686824-4301-419c-81dc-e29e46db9615 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:07.000351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76686824-4301-419c-81dc-e29e46db9615 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:07.000465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76686824-4301-419c-81dc-e29e46db9615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:07.019220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-76686824-4301-419c-81dc-e29e46db9615 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:07.020438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-76686824-4301-419c-81dc-e29e46db9615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:07.029999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 677/1384] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:31:07.075040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a694d5-4ca4-49af-9ef7-9b8aa09136fe None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:07.090232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a694d5-4ca4-49af-9ef7-9b8aa09136fe None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:07.095465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b317a3f-8f2b-46e1-ae72-02a0e4165715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:07.096107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b317a3f-8f2b-46e1-ae72-02a0e4165715 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:07.096394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b317a3f-8f2b-46e1-ae72-02a0e4165715 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:07.096664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b317a3f-8f2b-46e1-ae72-02a0e4165715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:07.105431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b317a3f-8f2b-46e1-ae72-02a0e4165715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:07.107125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b317a3f-8f2b-46e1-ae72-02a0e4165715 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:07.117503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 708/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:09.164185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bedcdd-1bbd-4211-95ce-bc4b02ee52b2 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:09.164686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bedcdd-1bbd-4211-95ce-bc4b02ee52b2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:09.164796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bedcdd-1bbd-4211-95ce-bc4b02ee52b2 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:09.166203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 678/1386] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:09.171706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60b63-d664-4b46-818d-d9cb909539c5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:09.172549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60b63-d664-4b46-818d-d9cb909539c5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:09.172549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b60b63-d664-4b46-818d-d9cb909539c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:09.193273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-72b60b63-d664-4b46-818d-d9cb909539c5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:09.194525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-72b60b63-d664-4b46-818d-d9cb909539c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:09.204851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 709/1387] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:09.250637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bedcdd-1bbd-4211-95ce-bc4b02ee52b2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:09.265449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bedcdd-1bbd-4211-95ce-bc4b02ee52b2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:09.271242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec8ac9-ca88-4e0b-b438-d9099a5a2ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:09.271889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8ac9-ca88-4e0b-b438-d9099a5a2ebf service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:09.272215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8ac9-ca88-4e0b-b438-d9099a5a2ebf service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:09.272450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8ac9-ca88-4e0b-b438-d9099a5a2ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:09.281271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec8ac9-ca88-4e0b-b438-d9099a5a2ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:09.283101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec8ac9-ca88-4e0b-b438-d9099a5a2ebf service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:09.293156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 679/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:11.490072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69369b59-aac3-4209-933e-7a87517dbe98 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:11.490792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69369b59-aac3-4209-933e-7a87517dbe98 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:11.490792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69369b59-aac3-4209-933e-7a87517dbe98 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:11.493228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 710/1389] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:31:11.499688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7489f-de61-4e48-bbf1-025a898fcb1e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:11.500183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7489f-de61-4e48-bbf1-025a898fcb1e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:11.500433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7489f-de61-4e48-bbf1-025a898fcb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:11.521108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bac7489f-de61-4e48-bbf1-025a898fcb1e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:11.522345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bac7489f-de61-4e48-bbf1-025a898fcb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:11.530742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 680/1390] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:11.577594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69369b59-aac3-4209-933e-7a87517dbe98 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:11.597527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69369b59-aac3-4209-933e-7a87517dbe98 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:11.604059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbffc8-258d-4ab7-9dfa-4f7b287db052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:11.604786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbffc8-258d-4ab7-9dfa-4f7b287db052 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:11.605099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbffc8-258d-4ab7-9dfa-4f7b287db052 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:11.605381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbffc8-258d-4ab7-9dfa-4f7b287db052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:11.614076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbffc8-258d-4ab7-9dfa-4f7b287db052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:11.615665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbffc8-258d-4ab7-9dfa-4f7b287db052 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:11.625615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 711/1391] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:13.768532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa6ab-0432-4ab8-bb00-371725564a43 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:13.769098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa6ab-0432-4ab8-bb00-371725564a43 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:13.769098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa6ab-0432-4ab8-bb00-371725564a43 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:13.770583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 681/1392] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:13.776598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacebe2-7f9e-44cf-b304-252b6e8f7636 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:13.777052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacebe2-7f9e-44cf-b304-252b6e8f7636 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:13.777300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacebe2-7f9e-44cf-b304-252b6e8f7636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:13.800840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-afacebe2-7f9e-44cf-b304-252b6e8f7636 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:13.801861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-afacebe2-7f9e-44cf-b304-252b6e8f7636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:13.811869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 712/1393] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:13.870340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fa6ab-0432-4ab8-bb00-371725564a43 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:13.888603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fa6ab-0432-4ab8-bb00-371725564a43 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:13.894657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727eb2cc-5782-4219-9468-553db6920f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:13.895371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eb2cc-5782-4219-9468-553db6920f9a service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:13.895639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eb2cc-5782-4219-9468-553db6920f9a service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:13.895833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727eb2cc-5782-4219-9468-553db6920f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:13.904391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eb2cc-5782-4219-9468-553db6920f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:13.906015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727eb2cc-5782-4219-9468-553db6920f9a service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:13.915473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 682/1394] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:15.975359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dbe96-b26b-44c4-8085-8f9f90470524 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:15.975945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dbe96-b26b-44c4-8085-8f9f90470524 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:15.975945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3dbe96-b26b-44c4-8085-8f9f90470524 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:15.977261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 713/1395] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:15.982916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412f531-f9a8-438f-9900-871e2584e716 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:15.983366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412f531-f9a8-438f-9900-871e2584e716 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:15.983473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412f531-f9a8-438f-9900-871e2584e716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:16.004526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c412f531-f9a8-438f-9900-871e2584e716 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:16.005745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c412f531-f9a8-438f-9900-871e2584e716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:16.015442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 683/1396] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:16.059820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dbe96-b26b-44c4-8085-8f9f90470524 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:16.075428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3dbe96-b26b-44c4-8085-8f9f90470524 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:16.081665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67364-b504-4039-962a-b907e7f160ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:16.082373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67364-b504-4039-962a-b907e7f160ff service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:16.082656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67364-b504-4039-962a-b907e7f160ff service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:16.082930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67364-b504-4039-962a-b907e7f160ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:16.092241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c67364-b504-4039-962a-b907e7f160ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:16.093853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c67364-b504-4039-962a-b907e7f160ff service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:16.104680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 714/1397] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:16.916973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dad43f-323a-430b-97fc-28cdf7a51dbe None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:16.917382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dad43f-323a-430b-97fc-28cdf7a51dbe None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:16.917836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dad43f-323a-430b-97fc-28cdf7a51dbe None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:16.919352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 684/1398] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:16.924830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027cc71-d0a8-4ddb-b088-1139640a6e9b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:16.925153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027cc71-d0a8-4ddb-b088-1139640a6e9b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:16.925435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027cc71-d0a8-4ddb-b088-1139640a6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:16.943775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-0027cc71-d0a8-4ddb-b088-1139640a6e9b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:16.944978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0027cc71-d0a8-4ddb-b088-1139640a6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:16.953485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 715/1399] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:31:17.011692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486beb5c-db86-4032-9b6b-8bca32857d79 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:17.012193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486beb5c-db86-4032-9b6b-8bca32857d79 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:17.012291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486beb5c-db86-4032-9b6b-8bca32857d79 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:17.013596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 685/1400] 10.222.0.61 () {54 vars in 962 bytes} [Fri Jul 1 19:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:17.018930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c862-1e2e-4615-8fa7-278049c1d682 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:17.019379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c862-1e2e-4615-8fa7-278049c1d682 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:17.019642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c862-1e2e-4615-8fa7-278049c1d682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:17.071297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b4d5c862-1e2e-4615-8fa7-278049c1d682 None None] MFA Rules not processed for user `ca1a1889e2fb436a86c5e68bf9f1e608`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:17.072506 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b4d5c862-1e2e-4615-8fa7-278049c1d682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:17.138889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 716/1401] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Jul 1 19:31:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:17.146622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486beb5c-db86-4032-9b6b-8bca32857d79 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:17.157795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486beb5c-db86-4032-9b6b-8bca32857d79 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:17.161493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226de8f-bede-415a-81ad-0381a3b5be62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1a1889e2fb436a86c5e68bf9f1e608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:17.162227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226de8f-bede-415a-81ad-0381a3b5be62 service glance] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:17.162470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226de8f-bede-415a-81ad-0381a3b5be62 service glance] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:17.162741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226de8f-bede-415a-81ad-0381a3b5be62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:17.172307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226de8f-bede-415a-81ad-0381a3b5be62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:17.173712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226de8f-bede-415a-81ad-0381a3b5be62 service glance] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:17.183646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 686/1402] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:31:17.896845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5140c4c-5d90-4df4-a147-f2f07c378363 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:17.897143 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5140c4c-5d90-4df4-a147-f2f07c378363 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:17.897427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5140c4c-5d90-4df4-a147-f2f07c378363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:17.948030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e5140c4c-5d90-4df4-a147-f2f07c378363 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:17.949321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e5140c4c-5d90-4df4-a147-f2f07c378363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:17.990087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:31:18.015224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 717/1403] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:31:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:18.060967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19c14a-b2b4-4613-9095-76ec49a11b2f None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:18.061478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19c14a-b2b4-4613-9095-76ec49a11b2f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:18.061583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19c14a-b2b4-4613-9095-76ec49a11b2f None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:18.062914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 687/1404] 10.222.0.61 () {54 vars in 942 bytes} [Fri Jul 1 19:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:18.069366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a02a-ccfd-4b1e-91f5-5ee5f70588f7 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:18.069846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a02a-ccfd-4b1e-91f5-5ee5f70588f7 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:18.070221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b5a02a-ccfd-4b1e-91f5-5ee5f70588f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:18.120650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-52b5a02a-ccfd-4b1e-91f5-5ee5f70588f7 None None] MFA Rules not processed for user `6de49ef308324229b81a8fa6f3f84287`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:18.121726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-52b5a02a-ccfd-4b1e-91f5-5ee5f70588f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:18.155001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c5c79-1520-4999-b1e4-12fd4016ba41 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:18.155308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c5c79-1520-4999-b1e4-12fd4016ba41 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:18.155583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c5c79-1520-4999-b1e4-12fd4016ba41 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:18.156974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 688/1405] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:31:18.161964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f982473-54dd-4e33-ac46-c82e7d15769e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:18.162296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f982473-54dd-4e33-ac46-c82e7d15769e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:18.162782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f982473-54dd-4e33-ac46-c82e7d15769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:18.180472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-9f982473-54dd-4e33-ac46-c82e7d15769e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:18.181721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9f982473-54dd-4e33-ac46-c82e7d15769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:18.197979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 689/1406] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:31:18.198346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 718/1407] 10.222.0.61 () {58 vars in 1039 bytes} [Fri Jul 1 19:31:18 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:18.203770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f982473-54dd-4e33-ac46-c82e7d15769e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:18.215738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f982473-54dd-4e33-ac46-c82e7d15769e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:18.221166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173032-5320-4728-a9fd-0b4eaf8bc538 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:18.222290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173032-5320-4728-a9fd-0b4eaf8bc538 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:18.222290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173032-5320-4728-a9fd-0b4eaf8bc538 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:18.222470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173032-5320-4728-a9fd-0b4eaf8bc538 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:18.231306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173032-5320-4728-a9fd-0b4eaf8bc538 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:18.232916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173032-5320-4728-a9fd-0b4eaf8bc538 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:18.235591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a02a-ccfd-4b1e-91f5-5ee5f70588f7 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:18.241025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 690/1408] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:31:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:31:18.248210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b5a02a-ccfd-4b1e-91f5-5ee5f70588f7 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:18.253853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678b950-5075-4f19-b8bc-aa646a1b190e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:18.254648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678b950-5075-4f19-b8bc-aa646a1b190e service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:18.254922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678b950-5075-4f19-b8bc-aa646a1b190e service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:18.255071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678b950-5075-4f19-b8bc-aa646a1b190e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:18.265245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678b950-5075-4f19-b8bc-aa646a1b190e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:18.267019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678b950-5075-4f19-b8bc-aa646a1b190e service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:18.277365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 719/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:31:28.237909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=69 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:31:28.272568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=59 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:31:40.212849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42750c-7080-4259-9a7c-4d65dcec08a9 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:40.213475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42750c-7080-4259-9a7c-4d65dcec08a9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:40.213475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42750c-7080-4259-9a7c-4d65dcec08a9 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:40.214892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 691/1410] 10.222.0.61 () {54 vars in 918 bytes} [Fri Jul 1 19:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:40.220224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d2d8-3ed7-4731-9074-ebde2bdbc0c7 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:40.220669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d2d8-3ed7-4731-9074-ebde2bdbc0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:40.220821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d2d8-3ed7-4731-9074-ebde2bdbc0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:40.239806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-5b20d2d8-3ed7-4731-9074-ebde2bdbc0c7 None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:40.241041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5b20d2d8-3ed7-4731-9074-ebde2bdbc0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:40.251353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 720/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Fri Jul 1 19:31:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:40.266044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a5e0-f1aa-4380-86e2-02a67e7df363 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:40.266415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a5e0-f1aa-4380-86e2-02a67e7df363 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:40.266754 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026a5e0-f1aa-4380-86e2-02a67e7df363 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:40.268230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 692/1412] 10.222.0.61 () {54 vars in 918 bytes} [Fri Jul 1 19:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:40.273030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067dca1-0bc9-4877-8013-7c7e0570e208 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:40.273321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067dca1-0bc9-4877-8013-7c7e0570e208 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:40.273603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067dca1-0bc9-4877-8013-7c7e0570e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:40.291750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4067dca1-0bc9-4877-8013-7c7e0570e208 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:40.292941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4067dca1-0bc9-4877-8013-7c7e0570e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:40.304928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 721/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Fri Jul 1 19:31:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:42.796060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddefc1-1b43-4a8c-83b6-3e38b8fcd66e None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:42.796680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddefc1-1b43-4a8c-83b6-3e38b8fcd66e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:42.796680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddefc1-1b43-4a8c-83b6-3e38b8fcd66e None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:42.797974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 693/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:42.804465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f0310-3473-4ab0-a32f-d313e55216aa None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:42.805230 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f0310-3473-4ab0-a32f-d313e55216aa None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:42.805423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f0310-3473-4ab0-a32f-d313e55216aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:42.831739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ae0f0310-3473-4ab0-a32f-d313e55216aa None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:42.832954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ae0f0310-3473-4ab0-a32f-d313e55216aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:42.841377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 722/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:42.883787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddefc1-1b43-4a8c-83b6-3e38b8fcd66e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:42.899725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddefc1-1b43-4a8c-83b6-3e38b8fcd66e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:42.905575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd7a89-6690-46d4-b031-127c09ff9c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:42.906653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7a89-6690-46d4-b031-127c09ff9c89 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:42.907054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7a89-6690-46d4-b031-127c09ff9c89 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:42.907425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd7a89-6690-46d4-b031-127c09ff9c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:42.917102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd7a89-6690-46d4-b031-127c09ff9c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:42.918783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd7a89-6690-46d4-b031-127c09ff9c89 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:42.928924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 694/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:43.852621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592d4cd-cf10-4bac-8186-7056856759df None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:43.853517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592d4cd-cf10-4bac-8186-7056856759df None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:43.853517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592d4cd-cf10-4bac-8186-7056856759df None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:43.855890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 723/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:31:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:43.861249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e33-926d-44a2-bc1c-5d045dff4807 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:43.861735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e33-926d-44a2-bc1c-5d045dff4807 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:43.861865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46e33-926d-44a2-bc1c-5d045dff4807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:43.881515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-e9b46e33-926d-44a2-bc1c-5d045dff4807 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:43.882737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e9b46e33-926d-44a2-bc1c-5d045dff4807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:43.891638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 695/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:44.047410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592d4cd-cf10-4bac-8186-7056856759df None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:44.065522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592d4cd-cf10-4bac-8186-7056856759df None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:44.072282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a924db-6851-4bc1-9b0b-4407f7218199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:44.072930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a924db-6851-4bc1-9b0b-4407f7218199 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:44.073215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a924db-6851-4bc1-9b0b-4407f7218199 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:44.073491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a924db-6851-4bc1-9b0b-4407f7218199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:44.082153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a924db-6851-4bc1-9b0b-4407f7218199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:44.084074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a924db-6851-4bc1-9b0b-4407f7218199 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:44.093698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 724/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:44.985740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d684b-d30c-4507-8fe1-d92cb14481bb None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:44.986672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d684b-d30c-4507-8fe1-d92cb14481bb None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:44.986672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d684b-d30c-4507-8fe1-d92cb14481bb None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:44.988908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 696/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:31:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:44.997621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a61a3-9701-4989-b746-e7441c6e8a64 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:44.998070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a61a3-9701-4989-b746-e7441c6e8a64 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:44.998212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a61a3-9701-4989-b746-e7441c6e8a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:45.017101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-413a61a3-9701-4989-b746-e7441c6e8a64 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:45.018345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-413a61a3-9701-4989-b746-e7441c6e8a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:45.027136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 725/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:45.179286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d684b-d30c-4507-8fe1-d92cb14481bb None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:45.201210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d684b-d30c-4507-8fe1-d92cb14481bb None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:45.207928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2abc5-ef52-4e75-b074-aac15b3f72c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:45.208903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2abc5-ef52-4e75-b074-aac15b3f72c6 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:45.209180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2abc5-ef52-4e75-b074-aac15b3f72c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:45.209448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2abc5-ef52-4e75-b074-aac15b3f72c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:45.218355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2abc5-ef52-4e75-b074-aac15b3f72c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:45.219944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2abc5-ef52-4e75-b074-aac15b3f72c6 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:45.229865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 697/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:46.097609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220e83e-f2a4-456a-a872-9d870dc06e37 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:46.098134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220e83e-f2a4-456a-a872-9d870dc06e37 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:46.098233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220e83e-f2a4-456a-a872-9d870dc06e37 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:46.099623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 726/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:46.104847 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755e11-f0d9-462a-a445-b958420bf88f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:46.105247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755e11-f0d9-462a-a445-b958420bf88f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:46.105392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99755e11-f0d9-462a-a445-b958420bf88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:46.124617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-99755e11-f0d9-462a-a445-b958420bf88f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:46.125797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-99755e11-f0d9-462a-a445-b958420bf88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:46.134795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 698/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:46.285307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220e83e-f2a4-456a-a872-9d870dc06e37 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:46.311649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220e83e-f2a4-456a-a872-9d870dc06e37 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:46.319186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9ee27-1025-4cab-855a-bab9a162bb9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:46.319829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ee27-1025-4cab-855a-bab9a162bb9e service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:46.320112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ee27-1025-4cab-855a-bab9a162bb9e service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:46.320386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ee27-1025-4cab-855a-bab9a162bb9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:46.329131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9ee27-1025-4cab-855a-bab9a162bb9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:46.330801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9ee27-1025-4cab-855a-bab9a162bb9e service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:46.340717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 727/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:47.215481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c4ff-d00b-435c-9275-7b477e524522 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:47.215997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c4ff-d00b-435c-9275-7b477e524522 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:47.215997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c4ff-d00b-435c-9275-7b477e524522 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:47.217606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 699/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:47.225727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1237-69c5-4498-ba87-995c056feb79 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:47.226198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1237-69c5-4498-ba87-995c056feb79 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:47.226391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c1237-69c5-4498-ba87-995c056feb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:47.253732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-9c9c1237-69c5-4498-ba87-995c056feb79 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:47.254953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9c9c1237-69c5-4498-ba87-995c056feb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:47.264192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 728/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:47.416284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c4ff-d00b-435c-9275-7b477e524522 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:47.434838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c4ff-d00b-435c-9275-7b477e524522 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:47.441332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1461d0c-ce87-46c3-842e-287779625864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:47.442004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1461d0c-ce87-46c3-842e-287779625864 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:47.442289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1461d0c-ce87-46c3-842e-287779625864 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:47.442563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1461d0c-ce87-46c3-842e-287779625864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:47.451675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1461d0c-ce87-46c3-842e-287779625864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:47.453275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1461d0c-ce87-46c3-842e-287779625864 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:47.463446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 700/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:48.280752 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca874c-dbdc-4045-9d8f-283c334765ef None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:48.281313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca874c-dbdc-4045-9d8f-283c334765ef None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:48.281313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca874c-dbdc-4045-9d8f-283c334765ef None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:48.282783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 729/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:48.288772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff7f07-3397-4b81-ae59-342d6288462d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:48.289435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff7f07-3397-4b81-ae59-342d6288462d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:48.289581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff7f07-3397-4b81-ae59-342d6288462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:48.310808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3bff7f07-3397-4b81-ae59-342d6288462d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:48.312073 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3bff7f07-3397-4b81-ae59-342d6288462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:48.321402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 701/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:48.472306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca874c-dbdc-4045-9d8f-283c334765ef None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:48.492596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca874c-dbdc-4045-9d8f-283c334765ef None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:48.498793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf8feb-84b0-49ff-85da-f499e7ab8ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:48.499421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8feb-84b0-49ff-85da-f499e7ab8ab2 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:48.499703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8feb-84b0-49ff-85da-f499e7ab8ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:48.499976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8feb-84b0-49ff-85da-f499e7ab8ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:48.508600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf8feb-84b0-49ff-85da-f499e7ab8ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:48.510227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf8feb-84b0-49ff-85da-f499e7ab8ab2 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:48.519935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 730/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:49.317617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5503f-d367-4b7a-bfa0-a49a2a33df9f None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:49.318400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5503f-d367-4b7a-bfa0-a49a2a33df9f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:49.318694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5503f-d367-4b7a-bfa0-a49a2a33df9f None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:49.320105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 702/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:31:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:49.325134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e20a-0a84-4560-8cfd-c98fb7ca52ff None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:49.325519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e20a-0a84-4560-8cfd-c98fb7ca52ff None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:49.325722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71e20a-0a84-4560-8cfd-c98fb7ca52ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:49.345554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ad71e20a-0a84-4560-8cfd-c98fb7ca52ff None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:49.346748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ad71e20a-0a84-4560-8cfd-c98fb7ca52ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:49.355003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 731/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:49.507229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5503f-d367-4b7a-bfa0-a49a2a33df9f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:49.525753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5503f-d367-4b7a-bfa0-a49a2a33df9f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:49.532029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956d1c-9a46-4161-b290-97c70bd0f0c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:49.532668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956d1c-9a46-4161-b290-97c70bd0f0c3 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:49.532954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956d1c-9a46-4161-b290-97c70bd0f0c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:49.533229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956d1c-9a46-4161-b290-97c70bd0f0c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:49.541781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956d1c-9a46-4161-b290-97c70bd0f0c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:49.543413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956d1c-9a46-4161-b290-97c70bd0f0c3 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:49.553043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 703/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:50.388394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3642629-fd49-4e1a-8307-4f9ca8be86eb None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:50.388968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3642629-fd49-4e1a-8307-4f9ca8be86eb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:50.388968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3642629-fd49-4e1a-8307-4f9ca8be86eb None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:50.390368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 732/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:50.396540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f016b-7ca8-43ac-bab2-ca2f237c6b88 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:50.397278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f016b-7ca8-43ac-bab2-ca2f237c6b88 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:50.397446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f016b-7ca8-43ac-bab2-ca2f237c6b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:50.425412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-136f016b-7ca8-43ac-bab2-ca2f237c6b88 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:50.426616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-136f016b-7ca8-43ac-bab2-ca2f237c6b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:50.435620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 704/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:50.592763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3642629-fd49-4e1a-8307-4f9ca8be86eb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:50.614187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3642629-fd49-4e1a-8307-4f9ca8be86eb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:50.620502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec83424-7fd5-41e5-a573-6a754f6379f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:50.621138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83424-7fd5-41e5-a573-6a754f6379f9 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:50.621421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83424-7fd5-41e5-a573-6a754f6379f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:50.621696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec83424-7fd5-41e5-a573-6a754f6379f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:50.631079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec83424-7fd5-41e5-a573-6a754f6379f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:50.632723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec83424-7fd5-41e5-a573-6a754f6379f9 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:50.643057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 733/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:51.440914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eed49-f35e-4988-9336-1b12fb321e9f None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:51.441792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eed49-f35e-4988-9336-1b12fb321e9f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:51.441792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eed49-f35e-4988-9336-1b12fb321e9f None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:51.444082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 705/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:31:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:51.450203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90709264-13d1-4416-8fc1-307358bafb33 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:51.450914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90709264-13d1-4416-8fc1-307358bafb33 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:51.451296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90709264-13d1-4416-8fc1-307358bafb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:51.476798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-90709264-13d1-4416-8fc1-307358bafb33 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:51.478042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-90709264-13d1-4416-8fc1-307358bafb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:51.487987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 734/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:51.647557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eed49-f35e-4988-9336-1b12fb321e9f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:51.666462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eed49-f35e-4988-9336-1b12fb321e9f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:51.673901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8942634-cf8e-4241-b3c0-e3c827efb238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:51.675031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942634-cf8e-4241-b3c0-e3c827efb238 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:51.675454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942634-cf8e-4241-b3c0-e3c827efb238 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:51.675958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8942634-cf8e-4241-b3c0-e3c827efb238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:51.686162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8942634-cf8e-4241-b3c0-e3c827efb238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:51.687845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8942634-cf8e-4241-b3c0-e3c827efb238 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:51.699515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 706/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:53.601520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158d44-9446-473a-b569-b089b4b461e0 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:53.602572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158d44-9446-473a-b569-b089b4b461e0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:53.602572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00158d44-9446-473a-b569-b089b4b461e0 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:53.604773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 735/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:31:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:53.610873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da054f-4714-45f5-a195-4d0ad9955703 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:53.611330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da054f-4714-45f5-a195-4d0ad9955703 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:53.611442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da054f-4714-45f5-a195-4d0ad9955703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:53.629615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-20da054f-4714-45f5-a195-4d0ad9955703 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:53.630821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-20da054f-4714-45f5-a195-4d0ad9955703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:53.639705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 707/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:53.681582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00158d44-9446-473a-b569-b089b4b461e0 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:53.696542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00158d44-9446-473a-b569-b089b4b461e0 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:53.701011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0192e-b8f3-40b4-9738-b8d2dc43b534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:53.701651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0192e-b8f3-40b4-9738-b8d2dc43b534 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:53.702075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0192e-b8f3-40b4-9738-b8d2dc43b534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:53.702359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0192e-b8f3-40b4-9738-b8d2dc43b534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:53.715296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0192e-b8f3-40b4-9738-b8d2dc43b534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:53.716786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0192e-b8f3-40b4-9738-b8d2dc43b534 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:53.727848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 736/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:55.903811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611c2e9-4fe3-4c1d-b132-07a2c852f7ac None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:55.904421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611c2e9-4fe3-4c1d-b132-07a2c852f7ac None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:55.904421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611c2e9-4fe3-4c1d-b132-07a2c852f7ac None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:55.905729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 708/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:55.913547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f347-ce8a-43ae-9cc7-4d724ef2b6da None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:55.913994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f347-ce8a-43ae-9cc7-4d724ef2b6da None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:55.914144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f347-ce8a-43ae-9cc7-4d724ef2b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:55.939300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-eb34f347-ce8a-43ae-9cc7-4d724ef2b6da None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:55.940498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-eb34f347-ce8a-43ae-9cc7-4d724ef2b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:55.949511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 737/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:55.987482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611c2e9-4fe3-4c1d-b132-07a2c852f7ac None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:55.999890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611c2e9-4fe3-4c1d-b132-07a2c852f7ac None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:56.003989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f2645-3d01-4ecf-9ea1-a63bf1447928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:56.004615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2645-3d01-4ecf-9ea1-a63bf1447928 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:56.004900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2645-3d01-4ecf-9ea1-a63bf1447928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:56.005163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f2645-3d01-4ecf-9ea1-a63bf1447928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:56.015408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f2645-3d01-4ecf-9ea1-a63bf1447928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:56.016855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f2645-3d01-4ecf-9ea1-a63bf1447928 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:56.027667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 709/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:31:58.355135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bba31-02d2-4d32-977d-e09209776f7d None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:58.355960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bba31-02d2-4d32-977d-e09209776f7d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:58.355960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bba31-02d2-4d32-977d-e09209776f7d None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:58.358228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 738/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:31:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:31:58.367286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a76977-af5d-4aca-992c-190a4fbc556c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:58.367991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a76977-af5d-4aca-992c-190a4fbc556c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:58.368159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a76977-af5d-4aca-992c-190a4fbc556c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:58.388859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-91a76977-af5d-4aca-992c-190a4fbc556c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:31:58.390063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-91a76977-af5d-4aca-992c-190a4fbc556c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:31:58.398946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 710/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:31:58.439432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bba31-02d2-4d32-977d-e09209776f7d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:31:58.450961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18bba31-02d2-4d32-977d-e09209776f7d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:31:58.455383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ceb18-5c31-49e0-8849-35cf49f1d28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:31:58.456014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ceb18-5c31-49e0-8849-35cf49f1d28f service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:31:58.456287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ceb18-5c31-49e0-8849-35cf49f1d28f service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:31:58.456567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ceb18-5c31-49e0-8849-35cf49f1d28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:31:58.467061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ceb18-5c31-49e0-8849-35cf49f1d28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:31:58.468550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ceb18-5c31-49e0-8849-35cf49f1d28f service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:31:58.478623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 739/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:31:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:00.619815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9397-468d-4dae-b12e-fe2c29de3f91 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:00.620701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9397-468d-4dae-b12e-fe2c29de3f91 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:00.620701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9397-468d-4dae-b12e-fe2c29de3f91 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:00.622645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 711/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:32:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:00.628353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39b39-be28-4d51-bd79-53cb1aeef235 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:00.628782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39b39-be28-4d51-bd79-53cb1aeef235 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:00.628952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff39b39-be28-4d51-bd79-53cb1aeef235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:00.647875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-eff39b39-be28-4d51-bd79-53cb1aeef235 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:00.649050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-eff39b39-be28-4d51-bd79-53cb1aeef235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:00.657670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 740/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:00.696617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a9397-468d-4dae-b12e-fe2c29de3f91 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:00.713742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a9397-468d-4dae-b12e-fe2c29de3f91 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:00.718948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5411a1-766e-4f5f-beda-9a2aac00aaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:00.719667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5411a1-766e-4f5f-beda-9a2aac00aaed service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:00.719975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5411a1-766e-4f5f-beda-9a2aac00aaed service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:00.720247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5411a1-766e-4f5f-beda-9a2aac00aaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:00.730416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5411a1-766e-4f5f-beda-9a2aac00aaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:00.731841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5411a1-766e-4f5f-beda-9a2aac00aaed service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:00.741972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 712/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:02.888882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec632e6-205c-456d-8696-b72245b18f6b None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:02.889785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec632e6-205c-456d-8696-b72245b18f6b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:02.889785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec632e6-205c-456d-8696-b72245b18f6b None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:02.891958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 741/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:32:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:02.898465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f131c5-1346-4d23-b3ae-41df692962f3 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:02.898911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f131c5-1346-4d23-b3ae-41df692962f3 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:02.899082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f131c5-1346-4d23-b3ae-41df692962f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:02.920724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-59f131c5-1346-4d23-b3ae-41df692962f3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:02.921935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-59f131c5-1346-4d23-b3ae-41df692962f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:02.932158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 713/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:02.971928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec632e6-205c-456d-8696-b72245b18f6b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:02.984501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec632e6-205c-456d-8696-b72245b18f6b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:02.988823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a455b4-c154-45a5-b526-7ee98f89cd6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:02.989463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a455b4-c154-45a5-b526-7ee98f89cd6a service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:02.989748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a455b4-c154-45a5-b526-7ee98f89cd6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:02.990083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a455b4-c154-45a5-b526-7ee98f89cd6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:03.000102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a455b4-c154-45a5-b526-7ee98f89cd6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:03.001563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a455b4-c154-45a5-b526-7ee98f89cd6a service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:03.011426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 742/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:05.194002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7cd8-c2bc-48dc-8443-6423ebfd7466 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:05.194484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7cd8-c2bc-48dc-8443-6423ebfd7466 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:05.194595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7cd8-c2bc-48dc-8443-6423ebfd7466 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:05.195973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 714/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:32:05.201383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633cf2-1af8-4983-979e-0bea6c7391aa None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:05.201819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633cf2-1af8-4983-979e-0bea6c7391aa None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:05.201933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633cf2-1af8-4983-979e-0bea6c7391aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:05.221623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-17633cf2-1af8-4983-979e-0bea6c7391aa None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:05.222872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-17633cf2-1af8-4983-979e-0bea6c7391aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:05.232316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 743/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:05.273420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7cd8-c2bc-48dc-8443-6423ebfd7466 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:05.292441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7cd8-c2bc-48dc-8443-6423ebfd7466 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:05.297362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a4272-8ee6-4638-83b3-77047a3bcf6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:05.298146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a4272-8ee6-4638-83b3-77047a3bcf6a service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:05.298443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a4272-8ee6-4638-83b3-77047a3bcf6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:05.298714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a4272-8ee6-4638-83b3-77047a3bcf6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:05.307795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a4272-8ee6-4638-83b3-77047a3bcf6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:05.309448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a4272-8ee6-4638-83b3-77047a3bcf6a service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:05.319425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 715/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:07.403360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a033534-7d22-431f-9e3b-9878f44f8800 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:07.403910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a033534-7d22-431f-9e3b-9878f44f8800 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:07.403910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a033534-7d22-431f-9e3b-9878f44f8800 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:07.405358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 744/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:07.411535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8e264-90dc-438b-86af-a1ff4940713b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:07.412283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8e264-90dc-438b-86af-a1ff4940713b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:07.412385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8e264-90dc-438b-86af-a1ff4940713b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:07.434489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a7e8e264-90dc-438b-86af-a1ff4940713b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:07.435735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a7e8e264-90dc-438b-86af-a1ff4940713b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:07.447642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 716/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:07.487096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a033534-7d22-431f-9e3b-9878f44f8800 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:07.499080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a033534-7d22-431f-9e3b-9878f44f8800 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:07.504144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a7ef0-cd3c-4965-b033-d35059e65ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:07.504840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7ef0-cd3c-4965-b033-d35059e65ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:07.505125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7ef0-cd3c-4965-b033-d35059e65ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:07.505399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a7ef0-cd3c-4965-b033-d35059e65ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:07.515942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a7ef0-cd3c-4965-b033-d35059e65ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:07.517427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a7ef0-cd3c-4965-b033-d35059e65ea6 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:07.527238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 745/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:32:09.570584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e290a-6f69-4470-b0a8-a9a5ac24e007 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:09.571480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e290a-6f69-4470-b0a8-a9a5ac24e007 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:09.571480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e290a-6f69-4470-b0a8-a9a5ac24e007 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:09.573749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 717/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:32:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:09.580461 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d05e-4f95-433b-8b21-519d5cffa6fb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:09.581245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d05e-4f95-433b-8b21-519d5cffa6fb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:09.581427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d05e-4f95-433b-8b21-519d5cffa6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:09.592315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=79 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:32:09.605019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e7e1d05e-4f95-433b-8b21-519d5cffa6fb None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:09.606247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e7e1d05e-4f95-433b-8b21-519d5cffa6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:09.615292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 746/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:09.652696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e290a-6f69-4470-b0a8-a9a5ac24e007 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:09.659323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=73 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:32:09.668630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e290a-6f69-4470-b0a8-a9a5ac24e007 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:09.673085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dfe00-b49d-427f-84fd-4381f77ffada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:09.673718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dfe00-b49d-427f-84fd-4381f77ffada service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:09.674036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dfe00-b49d-427f-84fd-4381f77ffada service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:09.674307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dfe00-b49d-427f-84fd-4381f77ffada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:09.685751 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dfe00-b49d-427f-84fd-4381f77ffada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:09.687242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dfe00-b49d-427f-84fd-4381f77ffada service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:09.697722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 718/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:11.718626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a4f3-9d31-4ad7-bae2-1ac7cd743809 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:11.719443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a4f3-9d31-4ad7-bae2-1ac7cd743809 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:11.719443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8a4f3-9d31-4ad7-bae2-1ac7cd743809 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:11.721598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 747/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:32:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:11.730624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5dca4-8787-46a9-b547-f6247d0b527e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:11.731408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5dca4-8787-46a9-b547-f6247d0b527e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:11.731585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5dca4-8787-46a9-b547-f6247d0b527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:11.756926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0ca5dca4-8787-46a9-b547-f6247d0b527e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:11.758135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0ca5dca4-8787-46a9-b547-f6247d0b527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:11.767636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 719/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:11.804563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8a4f3-9d31-4ad7-bae2-1ac7cd743809 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:11.819874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8a4f3-9d31-4ad7-bae2-1ac7cd743809 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:11.825131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee845ca0-3b07-4935-9dd7-9cdebf29bc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:11.825801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ca0-3b07-4935-9dd7-9cdebf29bc9b service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:11.826161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ca0-3b07-4935-9dd7-9cdebf29bc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:11.826439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee845ca0-3b07-4935-9dd7-9cdebf29bc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:11.836799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845ca0-3b07-4935-9dd7-9cdebf29bc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:11.838264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee845ca0-3b07-4935-9dd7-9cdebf29bc9b service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:11.847854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 748/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:13.897237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dce008-92c6-49e4-8f02-114314bd5f02 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:13.898194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dce008-92c6-49e4-8f02-114314bd5f02 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:13.898194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dce008-92c6-49e4-8f02-114314bd5f02 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:13.900373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 720/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:32:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:13.907605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1aee-ab4f-4543-b930-3d7bffa6cd11 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:13.908045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1aee-ab4f-4543-b930-3d7bffa6cd11 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:13.908158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1aee-ab4f-4543-b930-3d7bffa6cd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:13.929285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-634f1aee-ab4f-4543-b930-3d7bffa6cd11 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:13.930527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-634f1aee-ab4f-4543-b930-3d7bffa6cd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:13.940473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 749/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:13.987342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dce008-92c6-49e4-8f02-114314bd5f02 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:14.000584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dce008-92c6-49e4-8f02-114314bd5f02 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:14.005220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f4770-9fec-4a53-986e-ee085fbd5177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:14.005859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f4770-9fec-4a53-986e-ee085fbd5177 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:14.006171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f4770-9fec-4a53-986e-ee085fbd5177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:14.006458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f4770-9fec-4a53-986e-ee085fbd5177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:14.016160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f4770-9fec-4a53-986e-ee085fbd5177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:14.017650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f4770-9fec-4a53-986e-ee085fbd5177 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:14.027262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 721/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:23.922496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=11 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:32:24.023071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=14 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:32:33.768546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29a87-6aa9-4fc5-bc24-730054c42b4a None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:33.769411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29a87-6aa9-4fc5-bc24-730054c42b4a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:33.769411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b29a87-6aa9-4fc5-bc24-730054c42b4a None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:33.771515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 750/1471] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:32:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:33.780198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3a70-2e47-4aa9-a549-820369f7297f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:33.780666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3a70-2e47-4aa9-a549-820369f7297f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:33.780780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3a70-2e47-4aa9-a549-820369f7297f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:33.799777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d7ba3a70-2e47-4aa9-a549-820369f7297f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:33.800954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d7ba3a70-2e47-4aa9-a549-820369f7297f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:33.809242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 722/1472] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:32:33.861597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cccfd-f9a0-4077-9620-d44c0223f291 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:33.861884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cccfd-f9a0-4077-9620-d44c0223f291 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:33.862188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cccfd-f9a0-4077-9620-d44c0223f291 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:33.863582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 751/1473] 10.222.0.61 () {54 vars in 962 bytes} [Fri Jul 1 19:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:33.868607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6f9c-4e3f-4a87-b559-03924cd521e7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:33.868891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6f9c-4e3f-4a87-b559-03924cd521e7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:33.869171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec6f9c-4e3f-4a87-b559-03924cd521e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:33.890413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0eec6f9c-4e3f-4a87-b559-03924cd521e7 None None] MFA Rules not processed for user `ca1a1889e2fb436a86c5e68bf9f1e608`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:33.891624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0eec6f9c-4e3f-4a87-b559-03924cd521e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:33.899594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 723/1474] 10.222.0.61 () {58 vars in 1059 bytes} [Fri Jul 1 19:32:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:33.907044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cccfd-f9a0-4077-9620-d44c0223f291 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:33.919557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cccfd-f9a0-4077-9620-d44c0223f291 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:33.924245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3d4de-6212-450e-a045-45c2b0512eb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1a1889e2fb436a86c5e68bf9f1e608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:33.924907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d4de-6212-450e-a045-45c2b0512eb9 service glance] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:33.925177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d4de-6212-450e-a045-45c2b0512eb9 service glance] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:33.925475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d4de-6212-450e-a045-45c2b0512eb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:33.941360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d4de-6212-450e-a045-45c2b0512eb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:33.943831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d4de-6212-450e-a045-45c2b0512eb9 service glance] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:33.957198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 752/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:36.061080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8d2f-40ef-4f87-8792-36956e08c797 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:36.062247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8d2f-40ef-4f87-8792-36956e08c797 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:36.062247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca8d2f-40ef-4f87-8792-36956e08c797 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:36.063035 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 724/1476] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:36.069507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0353-52b3-43d4-b176-1bd9306fb0f8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:36.070282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0353-52b3-43d4-b176-1bd9306fb0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:36.070482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca0353-52b3-43d4-b176-1bd9306fb0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:36.091344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-00ca0353-52b3-43d4-b176-1bd9306fb0f8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:36.092531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-00ca0353-52b3-43d4-b176-1bd9306fb0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:36.101710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 753/1477] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:36.126027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca8d2f-40ef-4f87-8792-36956e08c797 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:36.143915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca8d2f-40ef-4f87-8792-36956e08c797 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:36.149305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13b16b-f9b7-4245-8714-c9c813cd3223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:36.149989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13b16b-f9b7-4245-8714-c9c813cd3223 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:36.150255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13b16b-f9b7-4245-8714-c9c813cd3223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:36.150520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13b16b-f9b7-4245-8714-c9c813cd3223 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:36.151248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13b16b-f9b7-4245-8714-c9c813cd3223 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:36.153015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING py.warnings [None req-ed13b16b-f9b7-4245-8714-c9c813cd3223 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:32:36.153015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: warnings.warn(msg) Jul 01 19:32:36.153015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: Jul 01 19:32:36.154234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13b16b-f9b7-4245-8714-c9c813cd3223 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:36.173669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 725/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Fri Jul 1 19:32:36 2022] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:32:38.197254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa105d-584c-4a5b-9612-e0891af502d5 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:38.198188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa105d-584c-4a5b-9612-e0891af502d5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:38.198188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa105d-584c-4a5b-9612-e0891af502d5 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:38.200473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 754/1479] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:32:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:38.207393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988e7d-ff31-4061-8ed2-231b7286994f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:38.207850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988e7d-ff31-4061-8ed2-231b7286994f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:38.207974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae988e7d-ff31-4061-8ed2-231b7286994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:38.229868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ae988e7d-ff31-4061-8ed2-231b7286994f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:38.231095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ae988e7d-ff31-4061-8ed2-231b7286994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:38.240066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 726/1480] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:38.298593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa105d-584c-4a5b-9612-e0891af502d5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:38.314441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa105d-584c-4a5b-9612-e0891af502d5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:38.320416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc9bed-a1ac-475d-b089-4819a3963c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:38.321045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc9bed-a1ac-475d-b089-4819a3963c76 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:38.321327 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc9bed-a1ac-475d-b089-4819a3963c76 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:38.321601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc9bed-a1ac-475d-b089-4819a3963c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:38.329960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc9bed-a1ac-475d-b089-4819a3963c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:38.331862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc9bed-a1ac-475d-b089-4819a3963c76 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:38.341264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 755/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:40.548482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e237ac6-fe13-4748-930b-36f98c08879c None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:40.549371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e237ac6-fe13-4748-930b-36f98c08879c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:40.549371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e237ac6-fe13-4748-930b-36f98c08879c None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:40.551474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 727/1482] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:40.560317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf17cbe-4f86-49e3-90e9-b61d8489f231 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:40.560770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf17cbe-4f86-49e3-90e9-b61d8489f231 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:40.560919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf17cbe-4f86-49e3-90e9-b61d8489f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:40.585093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8bf17cbe-4f86-49e3-90e9-b61d8489f231 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:40.586314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8bf17cbe-4f86-49e3-90e9-b61d8489f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:40.595403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 756/1483] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:40.634704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e237ac6-fe13-4748-930b-36f98c08879c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:40.646612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e237ac6-fe13-4748-930b-36f98c08879c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:40.650480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea125d53-d4b6-4523-8bdb-0a7b47bc27ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:40.651133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125d53-d4b6-4523-8bdb-0a7b47bc27ea service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:40.651417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125d53-d4b6-4523-8bdb-0a7b47bc27ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:40.651695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea125d53-d4b6-4523-8bdb-0a7b47bc27ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:40.660602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea125d53-d4b6-4523-8bdb-0a7b47bc27ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:40.662040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea125d53-d4b6-4523-8bdb-0a7b47bc27ea service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:40.671555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 728/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:42.753382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d0691-a74f-4d1f-867a-747292b60122 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:42.754140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d0691-a74f-4d1f-867a-747292b60122 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:42.754140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d0691-a74f-4d1f-867a-747292b60122 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:42.755392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 757/1485] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:42.764028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5635-1300-4185-a550-cad6b5973ea1 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:42.764453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5635-1300-4185-a550-cad6b5973ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:42.764564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b5635-1300-4185-a550-cad6b5973ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:42.784866 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-884b5635-1300-4185-a550-cad6b5973ea1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:42.786086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-884b5635-1300-4185-a550-cad6b5973ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:42.795540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 729/1486] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:42.834400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d0691-a74f-4d1f-867a-747292b60122 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:42.851523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d0691-a74f-4d1f-867a-747292b60122 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:42.856829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d5e4e-78d1-4e0a-b495-11d6b1a3a5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:42.857615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d5e4e-78d1-4e0a-b495-11d6b1a3a5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:42.857935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d5e4e-78d1-4e0a-b495-11d6b1a3a5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:42.858302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d5e4e-78d1-4e0a-b495-11d6b1a3a5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:42.873165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d5e4e-78d1-4e0a-b495-11d6b1a3a5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:42.875270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d5e4e-78d1-4e0a-b495-11d6b1a3a5c0 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:42.889527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 758/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:45.019003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4ac6-5420-4eb2-8205-7b89080f18a1 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:45.019599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4ac6-5420-4eb2-8205-7b89080f18a1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:45.019599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b4ac6-5420-4eb2-8205-7b89080f18a1 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:45.020951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 730/1488] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:45.026538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a88b8-be37-446b-a8f7-beb561169a20 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:45.026962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a88b8-be37-446b-a8f7-beb561169a20 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:45.027083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a88b8-be37-446b-a8f7-beb561169a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:45.047109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6d3a88b8-be37-446b-a8f7-beb561169a20 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:45.048307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6d3a88b8-be37-446b-a8f7-beb561169a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:45.056798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 759/1489] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:45.097336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b4ac6-5420-4eb2-8205-7b89080f18a1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:45.109770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b4ac6-5420-4eb2-8205-7b89080f18a1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:45.114076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb66403-8974-4285-977d-5b5865eeed73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:45.114715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66403-8974-4285-977d-5b5865eeed73 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:45.114998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66403-8974-4285-977d-5b5865eeed73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:45.115278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66403-8974-4285-977d-5b5865eeed73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:45.124856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb66403-8974-4285-977d-5b5865eeed73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:45.126333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb66403-8974-4285-977d-5b5865eeed73 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:45.135896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 731/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:32:47.353584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959549-816e-476a-b947-c133a244d56b None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:47.354191 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959549-816e-476a-b947-c133a244d56b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:47.354191 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1959549-816e-476a-b947-c133a244d56b None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:47.355482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 760/1491] 10.222.0.61 () {54 vars in 926 bytes} [Fri Jul 1 19:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:32:47.364406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7c3a-0fc7-4a0a-b313-651460988912 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:47.365595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7c3a-0fc7-4a0a-b313-651460988912 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:47.365595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e7c3a-0fc7-4a0a-b313-651460988912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:47.393082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0a8e7c3a-0fc7-4a0a-b313-651460988912 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:32:47.394335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0a8e7c3a-0fc7-4a0a-b313-651460988912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:32:47.406945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 732/1492] 10.222.0.61 () {58 vars in 1023 bytes} [Fri Jul 1 19:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:32:47.451270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959549-816e-476a-b947-c133a244d56b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:32:47.464960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1959549-816e-476a-b947-c133a244d56b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:32:47.471530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c18ba-43d9-4ac6-bb31-27231411fc6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:32:47.472465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c18ba-43d9-4ac6-bb31-27231411fc6c service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:32:47.472834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c18ba-43d9-4ac6-bb31-27231411fc6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:32:47.473176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c18ba-43d9-4ac6-bb31-27231411fc6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:32:47.485899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c18ba-43d9-4ac6-bb31-27231411fc6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:32:47.487356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c18ba-43d9-4ac6-bb31-27231411fc6c service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:32:47.496801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 761/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:32:57.386733 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=33 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:32:57.492584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=33 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:27.912944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8696-0959-4082-bf7a-874dd7178fbf None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:27.913887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8696-0959-4082-bf7a-874dd7178fbf None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:27.913887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc8696-0959-4082-bf7a-874dd7178fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:27.942383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-dadc8696-0959-4082-bf7a-874dd7178fbf None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:27.943593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-dadc8696-0959-4082-bf7a-874dd7178fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:27.952536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 733/1494] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:27.961150 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496e4f-8d23-4444-947e-3b7886c1cfb5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:27.961689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496e4f-8d23-4444-947e-3b7886c1cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:27.961689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21496e4f-8d23-4444-947e-3b7886c1cfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:27.981264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-21496e4f-8d23-4444-947e-3b7886c1cfb5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:27.982503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-21496e4f-8d23-4444-947e-3b7886c1cfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:27.992010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 762/1495] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:27.996895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc8696-0959-4082-bf7a-874dd7178fbf None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.008967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc8696-0959-4082-bf7a-874dd7178fbf None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:28.018124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:28.018778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.019055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.019311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.020047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:34:28.020345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:28.021359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING py.warnings [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:28.021359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: warnings.warn(msg) Jul 01 19:34:28.021359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: Jul 01 19:34:28.022285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:28.034989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 734/1496] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:34:28.043405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21496e4f-8d23-4444-947e-3b7886c1cfb5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.053208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21496e4f-8d23-4444-947e-3b7886c1cfb5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:28.059195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:28.059876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.060113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.060419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.061560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:28.062953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING py.warnings [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:28.062953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: warnings.warn(msg) Jul 01 19:34:28.062953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: Jul 01 19:34:28.064172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:28.105490 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 763/1497] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:34:28 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:34:28.110029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.120402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a613f81-4f63-4a1a-b586-39f0a713b699 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:28.179747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:28.180329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.180605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.180875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.181576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:28.182628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING py.warnings [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:28.182628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: warnings.warn(msg) Jul 01 19:34:28.182628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: Jul 01 19:34:28.183829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:28.206415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 735/1498] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:34:28 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:34:28.210617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.221707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627de49e-250c-4dda-9363-e839a22fa177 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:28.226474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:28.227170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.227458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.227739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.228475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:28.229503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING py.warnings [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:28.229503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: warnings.warn(msg) Jul 01 19:34:28.229503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: Jul 01 19:34:28.230438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:28.243635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 764/1499] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:28.247807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.258054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e0f28-bb0f-4a82-9a40-637d6bcb7d99 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:28.264585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbeb09-fe87-4567-9b88-c864f8a16a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:28.265019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbeb09-fe87-4567-9b88-c864f8a16a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.265305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbeb09-fe87-4567-9b88-c864f8a16a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.265568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbeb09-fe87-4567-9b88-c864f8a16a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.266374 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbeb09-fe87-4567-9b88-c864f8a16a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:28.267566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING py.warnings [None req-83dbeb09-fe87-4567-9b88-c864f8a16a63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:28.267566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: warnings.warn(msg) Jul 01 19:34:28.267566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: Jul 01 19:34:28.268454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbeb09-fe87-4567-9b88-c864f8a16a63 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:28.282582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 736/1500] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:34:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:34:28.287063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.297756 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692384a1-d660-4b03-bc91-ef9980422d2e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:28.303719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9ce16-23ec-4f3b-9006-3f68a5a3eeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:28.304617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9ce16-23ec-4f3b-9006-3f68a5a3eeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.304930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9ce16-23ec-4f3b-9006-3f68a5a3eeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.305185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9ce16-23ec-4f3b-9006-3f68a5a3eeb9 admin admin] PATH_INFO: `/v3/projects/90cf9ad688384c2fa23158d094e9225b/users/149ecc53ba6c40ef882a6ecfc4f5867c/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.320729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9ce16-23ec-4f3b-9006-3f68a5a3eeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90cf9ad688384c2fa23158d094e9225b, user_id=149ecc53ba6c40ef882a6ecfc4f5867c, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:28.321763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING py.warnings [None req-37a9ce16-23ec-4f3b-9006-3f68a5a3eeb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:28.321763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: warnings.warn(msg) Jul 01 19:34:28.321763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: Jul 01 19:34:28.323760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9ce16-23ec-4f3b-9006-3f68a5a3eeb9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:28.343124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 765/1501] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:34:28 2022] PUT /identity/v3/projects/90cf9ad688384c2fa23158d094e9225b/users/149ecc53ba6c40ef882a6ecfc4f5867c/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:28.355455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b60b0b-0e12-4427-8253-4b9281517445 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.355790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b60b0b-0e12-4427-8253-4b9281517445 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.356055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b60b0b-0e12-4427-8253-4b9281517445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.383252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c6b60b0b-0e12-4427-8253-4b9281517445 None None] MFA Rules not processed for user `149ecc53ba6c40ef882a6ecfc4f5867c`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:28.384470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c6b60b0b-0e12-4427-8253-4b9281517445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:28.450918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 737/1502] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:28.464771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ca6d-3d0f-47c9-9cb2-48caaa629107 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.465054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ca6d-3d0f-47c9-9cb2-48caaa629107 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.465349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2ca6d-3d0f-47c9-9cb2-48caaa629107 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.466773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 766/1503] 10.222.0.61 () {54 vars in 963 bytes} [Fri Jul 1 19:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:34:28.472984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed56fd-352f-4943-b801-963058a08d0e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.473329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed56fd-352f-4943-b801-963058a08d0e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.473692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed56fd-352f-4943-b801-963058a08d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.499227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-32ed56fd-352f-4943-b801-963058a08d0e None None] MFA Rules not processed for user `bfbcf52f970e475c8d7f91d373949ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:28.500459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-32ed56fd-352f-4943-b801-963058a08d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:28.545669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:28.554707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 738/1504] 10.222.0.61 () {58 vars in 1060 bytes} [Fri Jul 1 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:28.562718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2ca6d-3d0f-47c9-9cb2-48caaa629107 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.574872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2ca6d-3d0f-47c9-9cb2-48caaa629107 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:28.579542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b894ab3-ead3-410d-be66-416f0de85387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:28.580170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b894ab3-ead3-410d-be66-416f0de85387 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.580443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b894ab3-ead3-410d-be66-416f0de85387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.580713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b894ab3-ead3-410d-be66-416f0de85387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.590250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b894ab3-ead3-410d-be66-416f0de85387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:28.591674 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b894ab3-ead3-410d-be66-416f0de85387 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:28.600917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 767/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:28.643332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7621d-7543-4a4d-b43d-30b33e9dcd5f None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.643622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7621d-7543-4a4d-b43d-30b33e9dcd5f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.643903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7621d-7543-4a4d-b43d-30b33e9dcd5f None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.645255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 739/1506] 10.222.0.61 () {52 vars in 829 bytes} [Fri Jul 1 19:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:34:28.649356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b894ab3-ead3-410d-be66-416f0de85387 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.722954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b894ab3-ead3-410d-be66-416f0de85387 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:28.728632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:28.729513 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.729796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.730103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] PATH_INFO: `/v3/users/149ecc53ba6c40ef882a6ecfc4f5867c` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.731323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149ecc53ba6c40ef882a6ecfc4f5867c)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:28.732336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING py.warnings [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:28.732336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: warnings.warn(msg) Jul 01 19:34:28.732336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: Jul 01 19:34:28.733552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:28.811259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149ecc53ba6c40ef882a6ecfc4f5867c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:28.828304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149ecc53ba6c40ef882a6ecfc4f5867c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:28.829548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149ecc53ba6c40ef882a6ecfc4f5867c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:28.842418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149ecc53ba6c40ef882a6ecfc4f5867c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:28.860432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:28.863696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149ecc53ba6c40ef882a6ecfc4f5867c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:28.876198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 768/1507] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:34:28 2022] DELETE /identity/v3/users/149ecc53ba6c40ef882a6ecfc4f5867c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:28.883915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dabd16-868a-43aa-842a-992547f7d980 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:28.884360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dabd16-868a-43aa-842a-992547f7d980 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:28.884848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dabd16-868a-43aa-842a-992547f7d980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:28.910489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-98dabd16-868a-43aa-842a-992547f7d980 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:34:28.911688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-98dabd16-868a-43aa-842a-992547f7d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:28.974304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 740/1508] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:34:28.987189 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:28.988754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:29.046569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e5b48-5d32-47e8-89b5-7119ea7ee964 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:29.050587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42c7b5-4813-48c1-be46-88e6140adc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:29.051243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c7b5-4813-48c1-be46-88e6140adc1e service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:29.051522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c7b5-4813-48c1-be46-88e6140adc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:29.051804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42c7b5-4813-48c1-be46-88e6140adc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:29.061481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42c7b5-4813-48c1-be46-88e6140adc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:29.062983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42c7b5-4813-48c1-be46-88e6140adc1e service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:29.073322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 769/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:34:29.442283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dabd16-868a-43aa-842a-992547f7d980 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:34:29.443772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-98dabd16-868a-43aa-842a-992547f7d980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:34:29.458897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dabd16-868a-43aa-842a-992547f7d980 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:34:29.465604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:34:29.466535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:34:29.466818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:34:29.467094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] PATH_INFO: `/v3/projects/90cf9ad688384c2fa23158d094e9225b` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:34:29.468387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=90cf9ad688384c2fa23158d094e9225b)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:34:29.469434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING py.warnings [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:34:29.469434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: warnings.warn(msg) Jul 01 19:34:29.469434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: Jul 01 19:34:29.470722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:34:29.540233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90cf9ad688384c2fa23158d094e9225b', 'request_id': 'req-e5494734-128a-47b6-b37b-8c77853cc2ca'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:29.551268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90cf9ad688384c2fa23158d094e9225b', 'request_id': 'req-e5494734-128a-47b6-b37b-8c77853cc2ca'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:29.557605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90cf9ad688384c2fa23158d094e9225b', 'request_id': 'req-e5494734-128a-47b6-b37b-8c77853cc2ca'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:29.576575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] The token cache is being invalidate because project 90cf9ad688384c2fa23158d094e9225b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:34:29.576877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:29.577624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5494734-128a-47b6-b37b-8c77853cc2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:34:29.579573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 741/1510] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:34:29 2022] DELETE /identity/v3/projects/90cf9ad688384c2fa23158d094e9225b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:34:39.068787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:34:39.573695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:15.206679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0fc7d-4f5e-4f26-b16f-04f68cf972a3 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.207318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0fc7d-4f5e-4f26-b16f-04f68cf972a3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.207318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0fc7d-4f5e-4f26-b16f-04f68cf972a3 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.208624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 770/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:15.213756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c015e-2b14-44a0-93e3-16f3e89559d8 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.214229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c015e-2b14-44a0-93e3-16f3e89559d8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.214440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c015e-2b14-44a0-93e3-16f3e89559d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.234129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5b4c015e-2b14-44a0-93e3-16f3e89559d8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:15.235310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5b4c015e-2b14-44a0-93e3-16f3e89559d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:15.293081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 742/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:15.447906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0fc7d-4f5e-4f26-b16f-04f68cf972a3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:15.451214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-dce0fc7d-4f5e-4f26-b16f-04f68cf972a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:15.541438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0fc7d-4f5e-4f26-b16f-04f68cf972a3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:15.547133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342aa604-1ada-4c24-8245-792f0fb55411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:15.547778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aa604-1ada-4c24-8245-792f0fb55411 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:15.548059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aa604-1ada-4c24-8245-792f0fb55411 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:15.548336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aa604-1ada-4c24-8245-792f0fb55411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:15.557011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aa604-1ada-4c24-8245-792f0fb55411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:15.558651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342aa604-1ada-4c24-8245-792f0fb55411 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:15.568111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 771/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:16.425999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20e82d-c4a5-40d8-ab76-737dfec7dc80 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:16.426858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20e82d-c4a5-40d8-ab76-737dfec7dc80 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:16.426858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20e82d-c4a5-40d8-ab76-737dfec7dc80 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:16.429152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 743/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:36:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:16.437351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47701-772c-412a-b054-9bd129a05f8a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:16.437771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47701-772c-412a-b054-9bd129a05f8a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:16.438027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e47701-772c-412a-b054-9bd129a05f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:16.466887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-51e47701-772c-412a-b054-9bd129a05f8a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:16.468755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-51e47701-772c-412a-b054-9bd129a05f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:16.478558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 772/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:16.643246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20e82d-c4a5-40d8-ab76-737dfec7dc80 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:16.668141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20e82d-c4a5-40d8-ab76-737dfec7dc80 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:16.674775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04308dae-319d-4421-9132-7bcabc31d79e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:16.675490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04308dae-319d-4421-9132-7bcabc31d79e service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:16.675774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04308dae-319d-4421-9132-7bcabc31d79e service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:16.676108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04308dae-319d-4421-9132-7bcabc31d79e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:16.684918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04308dae-319d-4421-9132-7bcabc31d79e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:16.686567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04308dae-319d-4421-9132-7bcabc31d79e service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:16.696509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 744/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:17.520360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf122-7053-416e-b61d-11be9530b19f None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:17.520940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf122-7053-416e-b61d-11be9530b19f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:17.520940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bf122-7053-416e-b61d-11be9530b19f None None] PATH_INFO: `/v3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:17.522706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 773/1517] 10.222.0.57 () {54 vars in 925 bytes} [Fri Jul 1 19:36:17 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:36:17.529723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6bb58-1b41-443a-9bed-2ebf071133ff None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:17.530228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6bb58-1b41-443a-9bed-2ebf071133ff None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:17.530330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6bb58-1b41-443a-9bed-2ebf071133ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:17.550853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-40f6bb58-1b41-443a-9bed-2ebf071133ff None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:17.552060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-40f6bb58-1b41-443a-9bed-2ebf071133ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:17.617167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 745/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Fri Jul 1 19:36:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:26.458967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=37 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:26.761920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f523d-643f-4387-a57d-b2f9bc505e17 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:26.762285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f523d-643f-4387-a57d-b2f9bc505e17 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:26.762678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f523d-643f-4387-a57d-b2f9bc505e17 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:26.764922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 774/1519] 10.222.0.61 () {54 vars in 960 bytes} [Fri Jul 1 19:36:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:26.772525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607854f-e893-4a4e-8899-514297da9f3b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:26.772999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607854f-e893-4a4e-8899-514297da9f3b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:26.773121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607854f-e893-4a4e-8899-514297da9f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:26.792604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1607854f-e893-4a4e-8899-514297da9f3b None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:26.793798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1607854f-e893-4a4e-8899-514297da9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:26.802883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 746/1520] 10.222.0.61 () {58 vars in 1057 bytes} [Fri Jul 1 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:36:26.810605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f523d-643f-4387-a57d-b2f9bc505e17 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:26.825423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f523d-643f-4387-a57d-b2f9bc505e17 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:26.831271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f968e-4a88-47d5-a6db-45ba86d7ecb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:26.831911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f968e-4a88-47d5-a6db-45ba86d7ecb7 service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:26.832196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f968e-4a88-47d5-a6db-45ba86d7ecb7 service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:26.832454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f968e-4a88-47d5-a6db-45ba86d7ecb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:26.840834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f968e-4a88-47d5-a6db-45ba86d7ecb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:26.842474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f968e-4a88-47d5-a6db-45ba86d7ecb7 service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:26.852443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 775/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:27.932962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508061db-77d0-49b5-bddc-5b4bf1532275 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:27.933576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508061db-77d0-49b5-bddc-5b4bf1532275 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:27.933576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508061db-77d0-49b5-bddc-5b4bf1532275 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:27.936000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 747/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:36:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:27.941788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b690d-d5fd-456d-9dde-3e972656e2aa None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:27.942532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b690d-d5fd-456d-9dde-3e972656e2aa None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:27.942736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b690d-d5fd-456d-9dde-3e972656e2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:27.966648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-0f1b690d-d5fd-456d-9dde-3e972656e2aa None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:27.967873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0f1b690d-d5fd-456d-9dde-3e972656e2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:27.977061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 776/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:28.136075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508061db-77d0-49b5-bddc-5b4bf1532275 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:28.158752 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508061db-77d0-49b5-bddc-5b4bf1532275 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:28.165229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4413c-904c-45fc-8b79-62e224158f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:28.165875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4413c-904c-45fc-8b79-62e224158f1a service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:28.166185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4413c-904c-45fc-8b79-62e224158f1a service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:28.166456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4413c-904c-45fc-8b79-62e224158f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:28.174712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4413c-904c-45fc-8b79-62e224158f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:28.176323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4413c-904c-45fc-8b79-62e224158f1a service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:28.185746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 748/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:29.006706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d93f9-f8ce-4e9d-9bfd-13d9f9d1244f None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:29.007308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d93f9-f8ce-4e9d-9bfd-13d9f9d1244f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:29.007308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d93f9-f8ce-4e9d-9bfd-13d9f9d1244f None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:29.008714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 777/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 19:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:29.014702 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe7ab-7e13-470a-9b1f-1890070d496f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:29.015445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe7ab-7e13-470a-9b1f-1890070d496f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:29.015837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efe7ab-7e13-470a-9b1f-1890070d496f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:29.045085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-04efe7ab-7e13-470a-9b1f-1890070d496f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:29.046342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-04efe7ab-7e13-470a-9b1f-1890070d496f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:29.056423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 749/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:29.216238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d93f9-f8ce-4e9d-9bfd-13d9f9d1244f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:29.233843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d93f9-f8ce-4e9d-9bfd-13d9f9d1244f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:29.241217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bbc55-4e12-4595-8568-e825197f4006 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:29.241886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bbc55-4e12-4595-8568-e825197f4006 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:29.242200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bbc55-4e12-4595-8568-e825197f4006 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:29.242468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bbc55-4e12-4595-8568-e825197f4006 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:29.251792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bbc55-4e12-4595-8568-e825197f4006 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:29.253378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bbc55-4e12-4595-8568-e825197f4006 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:29.263464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 778/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:33.394292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32bcda-cdbb-4308-a0bb-bac9da8b3b39 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:33.395181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32bcda-cdbb-4308-a0bb-bac9da8b3b39 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:33.395181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32bcda-cdbb-4308-a0bb-bac9da8b3b39 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:33.397252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 750/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:36:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:33.402987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0057-1b95-40f7-8be7-4d337e8a8127 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:33.403472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0057-1b95-40f7-8be7-4d337e8a8127 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:33.403571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0057-1b95-40f7-8be7-4d337e8a8127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:33.422197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-9ece0057-1b95-40f7-8be7-4d337e8a8127 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:33.423400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9ece0057-1b95-40f7-8be7-4d337e8a8127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:33.432938 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 779/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:33.470322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32bcda-cdbb-4308-a0bb-bac9da8b3b39 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:33.472189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9b32bcda-cdbb-4308-a0bb-bac9da8b3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:33.537105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32bcda-cdbb-4308-a0bb-bac9da8b3b39 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:33.540940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8b0f5-060f-45bd-a39c-4f39d591197f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:33.541592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b0f5-060f-45bd-a39c-4f39d591197f service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:33.541879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b0f5-060f-45bd-a39c-4f39d591197f service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:33.542192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b0f5-060f-45bd-a39c-4f39d591197f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:33.551451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8b0f5-060f-45bd-a39c-4f39d591197f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:33.552901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8b0f5-060f-45bd-a39c-4f39d591197f service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:33.557823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:33.562937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 751/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:35.607719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5516d-eb97-49cb-a2e9-46400887d7d0 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.608269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5516d-eb97-49cb-a2e9-46400887d7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.608269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5516d-eb97-49cb-a2e9-46400887d7d0 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.609620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 780/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:35.616093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3b81-ad8a-414f-9a6d-04cab95bb62d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.616852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3b81-ad8a-414f-9a6d-04cab95bb62d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.617017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db3b81-ad8a-414f-9a6d-04cab95bb62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.641137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a2db3b81-ad8a-414f-9a6d-04cab95bb62d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:35.642397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a2db3b81-ad8a-414f-9a6d-04cab95bb62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:35.652089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 752/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:35.688449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5516d-eb97-49cb-a2e9-46400887d7d0 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:35.706747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5516d-eb97-49cb-a2e9-46400887d7d0 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:35.713149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced22f34-c9f3-4e4b-a39a-9889eeef356e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:35.714019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22f34-c9f3-4e4b-a39a-9889eeef356e service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:35.714388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22f34-c9f3-4e4b-a39a-9889eeef356e service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:35.714782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced22f34-c9f3-4e4b-a39a-9889eeef356e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:35.725332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced22f34-c9f3-4e4b-a39a-9889eeef356e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:35.726830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced22f34-c9f3-4e4b-a39a-9889eeef356e service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:35.736614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 781/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:39.380031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe3baf-066c-4dcb-9b4b-3922dda2b51a None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:39.380561 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe3baf-066c-4dcb-9b4b-3922dda2b51a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:39.380561 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe3baf-066c-4dcb-9b4b-3922dda2b51a None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:39.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 753/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:39.390627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f7ef-2899-4e6d-bbed-6d8f18087bc9 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:39.391120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f7ef-2899-4e6d-bbed-6d8f18087bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:39.391223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315f7ef-2899-4e6d-bbed-6d8f18087bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:39.415244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6315f7ef-2899-4e6d-bbed-6d8f18087bc9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:39.416445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6315f7ef-2899-4e6d-bbed-6d8f18087bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:39.425235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 782/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:39.731175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe3baf-066c-4dcb-9b4b-3922dda2b51a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:39.733268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b5fe3baf-066c-4dcb-9b4b-3922dda2b51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:39.799780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe3baf-066c-4dcb-9b4b-3922dda2b51a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:39.804188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edfa5b0-bfd5-497d-a4be-8415e86f9e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:39.804834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa5b0-bfd5-497d-a4be-8415e86f9e42 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:39.805116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa5b0-bfd5-497d-a4be-8415e86f9e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:39.805395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edfa5b0-bfd5-497d-a4be-8415e86f9e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:39.815618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfa5b0-bfd5-497d-a4be-8415e86f9e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:39.817065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edfa5b0-bfd5-497d-a4be-8415e86f9e42 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:39.827785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 754/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:36:41.866320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734062-c865-4106-8fa6-7a6c52bcca92 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.866935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734062-c865-4106-8fa6-7a6c52bcca92 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.866935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7734062-c865-4106-8fa6-7a6c52bcca92 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.868876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 783/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 19:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:36:41.876645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b0112-3d93-4666-b7ac-d148c90c9f92 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:41.877118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b0112-3d93-4666-b7ac-d148c90c9f92 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:41.877213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b0112-3d93-4666-b7ac-d148c90c9f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:41.896576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-fc2b0112-3d93-4666-b7ac-d148c90c9f92 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:36:41.897788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fc2b0112-3d93-4666-b7ac-d148c90c9f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:41.906169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 755/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:36:42.207797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7734062-c865-4106-8fa6-7a6c52bcca92 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:36:42.209870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f7734062-c865-4106-8fa6-7a6c52bcca92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:36:42.225394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7734062-c865-4106-8fa6-7a6c52bcca92 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:36:42.229856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b44fc-2679-4c09-8e70-613eab372aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:36:42.230535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b44fc-2679-4c09-8e70-613eab372aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:36:42.230848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b44fc-2679-4c09-8e70-613eab372aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:36:42.231126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b44fc-2679-4c09-8e70-613eab372aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:36:42.240878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b44fc-2679-4c09-8e70-613eab372aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:36:42.242435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b44fc-2679-4c09-8e70-613eab372aa4 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:36:42.251929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 784/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:36:51.891247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=32 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:36:52.247991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=33 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:13.340383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783835a-2d7c-4fe7-bff7-b70231e983cc None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.346405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783835a-2d7c-4fe7-bff7-b70231e983cc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.346405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783835a-2d7c-4fe7-bff7-b70231e983cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.370385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-2783835a-2d7c-4fe7-bff7-b70231e983cc None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.371697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2783835a-2d7c-4fe7-bff7-b70231e983cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.382903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 756/1540] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:13.392515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf83d0-cc81-4ad9-a4b9-161c81a8498d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.393230 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf83d0-cc81-4ad9-a4b9-161c81a8498d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.393230 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf83d0-cc81-4ad9-a4b9-161c81a8498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.419335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f0cf83d0-cc81-4ad9-a4b9-161c81a8498d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.420608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f0cf83d0-cc81-4ad9-a4b9-161c81a8498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.436955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 785/1541] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:13.441497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783835a-2d7c-4fe7-bff7-b70231e983cc None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:13.457388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783835a-2d7c-4fe7-bff7-b70231e983cc None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:13.467941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295b572-2eef-46d5-a822-91c2cf313f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:13.468642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295b572-2eef-46d5-a822-91c2cf313f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.469085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295b572-2eef-46d5-a822-91c2cf313f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.469514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295b572-2eef-46d5-a822-91c2cf313f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.470316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295b572-2eef-46d5-a822-91c2cf313f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:13.470629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295b572-2eef-46d5-a822-91c2cf313f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:13.472287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295b572-2eef-46d5-a822-91c2cf313f91 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:13.492108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 757/1542] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:13.501227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf83d0-cc81-4ad9-a4b9-161c81a8498d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:13.515581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf83d0-cc81-4ad9-a4b9-161c81a8498d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:13.522717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4869d1-baa2-4e5a-a7d9-cef208c50254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:13.523450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4869d1-baa2-4e5a-a7d9-cef208c50254 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.523766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4869d1-baa2-4e5a-a7d9-cef208c50254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.524082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4869d1-baa2-4e5a-a7d9-cef208c50254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.524864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4869d1-baa2-4e5a-a7d9-cef208c50254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:13.526963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4869d1-baa2-4e5a-a7d9-cef208c50254 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:13.550878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913c739-9af5-47e1-802e-888d207bef9e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.551323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913c739-9af5-47e1-802e-888d207bef9e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.551476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913c739-9af5-47e1-802e-888d207bef9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.576179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a913c739-9af5-47e1-802e-888d207bef9e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.576602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 786/1543] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:13.577596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a913c739-9af5-47e1-802e-888d207bef9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.582441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4869d1-baa2-4e5a-a7d9-cef208c50254 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:13.656575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 758/1544] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:13.690513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231743-6faf-4160-a087-afe7be504dfa None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.690902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231743-6faf-4160-a087-afe7be504dfa None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.691073 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231743-6faf-4160-a087-afe7be504dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.725848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3a231743-6faf-4160-a087-afe7be504dfa None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.727182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3a231743-6faf-4160-a087-afe7be504dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.741159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 759/1545] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:13.744074 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548422-b655-4e26-8066-dc245e2cb52f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.744373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548422-b655-4e26-8066-dc245e2cb52f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.744799 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e548422-b655-4e26-8066-dc245e2cb52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.769152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8e548422-b655-4e26-8066-dc245e2cb52f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.774495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8e548422-b655-4e26-8066-dc245e2cb52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.788374 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 760/1546] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:13.789250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548422-b655-4e26-8066-dc245e2cb52f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:13.799515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e548422-b655-4e26-8066-dc245e2cb52f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:13.807991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325246ef-3043-45fb-94db-9b9dac4193cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:13.808680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325246ef-3043-45fb-94db-9b9dac4193cf admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.808960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325246ef-3043-45fb-94db-9b9dac4193cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.809234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325246ef-3043-45fb-94db-9b9dac4193cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.809997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325246ef-3043-45fb-94db-9b9dac4193cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:13.810313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325246ef-3043-45fb-94db-9b9dac4193cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:13.811937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325246ef-3043-45fb-94db-9b9dac4193cf admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:13.845547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 761/1547] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:13.848452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4869d1-baa2-4e5a-a7d9-cef208c50254 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:13.850989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa3ba-7f7f-4b10-8bb6-339dd10f00d5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.851280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa3ba-7f7f-4b10-8bb6-339dd10f00d5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.851574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271aa3ba-7f7f-4b10-8bb6-339dd10f00d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.861588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:13.862361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.862695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.862984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.863699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:13.864838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING py.warnings [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:38:13.864838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: warnings.warn(msg) Jul 01 19:38:13.864838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: Jul 01 19:38:13.866612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:13.889251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-271aa3ba-7f7f-4b10-8bb6-339dd10f00d5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.890640 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-271aa3ba-7f7f-4b10-8bb6-339dd10f00d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.902528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 762/1548] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:13.903836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16538c68-d942-48ac-ad2d-903a29974e47 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.904257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16538c68-d942-48ac-ad2d-903a29974e47 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.904543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16538c68-d942-48ac-ad2d-903a29974e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.908890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 787/1549] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/users => generated 288 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:38:13.909981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:13.920326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18ba3-dcc8-4dfd-930f-a0d5cf069c5f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:13.924346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-16538c68-d942-48ac-ad2d-903a29974e47 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.925531 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-16538c68-d942-48ac-ad2d-903a29974e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.925748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbebaf-12c3-4ca1-bb96-f110bcb848b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:13.926590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbebaf-12c3-4ca1-bb96-f110bcb848b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.926995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbebaf-12c3-4ca1-bb96-f110bcb848b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.927351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbebaf-12c3-4ca1-bb96-f110bcb848b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.927982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbebaf-12c3-4ca1-bb96-f110bcb848b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:13.930321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbebaf-12c3-4ca1-bb96-f110bcb848b1 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:13.933756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 763/1550] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:13.934973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97a0d-5013-49bb-bb9e-4e6010b3500d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.935262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97a0d-5013-49bb-bb9e-4e6010b3500d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.935536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97a0d-5013-49bb-bb9e-4e6010b3500d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.956602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d3d97a0d-5013-49bb-bb9e-4e6010b3500d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.956602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d3d97a0d-5013-49bb-bb9e-4e6010b3500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.965803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 764/1551] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:13.967475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84696-4c75-46f0-a197-0e238ad7099a None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.967758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84696-4c75-46f0-a197-0e238ad7099a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.968032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf84696-4c75-46f0-a197-0e238ad7099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.973734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 788/1552] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:13.973734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe777c-0c88-41a5-af3f-1a3f09c99b8c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:13.973734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe777c-0c88-41a5-af3f-1a3f09c99b8c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:13.973734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe777c-0c88-41a5-af3f-1a3f09c99b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:13.988896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7cf84696-4c75-46f0-a197-0e238ad7099a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.990115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7cf84696-4c75-46f0-a197-0e238ad7099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:13.991522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e9fe777c-0c88-41a5-af3f-1a3f09c99b8c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:13.992732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e9fe777c-0c88-41a5-af3f-1a3f09c99b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:14.047949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 765/1553] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.049183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf84696-4c75-46f0-a197-0e238ad7099a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.050905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 789/1554] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.051871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe777c-0c88-41a5-af3f-1a3f09c99b8c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.060528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf84696-4c75-46f0-a197-0e238ad7099a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.065972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be25506-1d67-4cba-8a3e-49f8e11dd3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.066700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be25506-1d67-4cba-8a3e-49f8e11dd3fc admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.066823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe777c-0c88-41a5-af3f-1a3f09c99b8c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.066990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be25506-1d67-4cba-8a3e-49f8e11dd3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.067253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be25506-1d67-4cba-8a3e-49f8e11dd3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.067987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be25506-1d67-4cba-8a3e-49f8e11dd3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:14.068297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be25506-1d67-4cba-8a3e-49f8e11dd3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.069916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be25506-1d67-4cba-8a3e-49f8e11dd3fc admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.071677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ca32a-a2be-44ba-979e-145d4dcfaf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.072334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ca32a-a2be-44ba-979e-145d4dcfaf05 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.072640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ca32a-a2be-44ba-979e-145d4dcfaf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.072909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ca32a-a2be-44ba-979e-145d4dcfaf05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.073636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ca32a-a2be-44ba-979e-145d4dcfaf05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.075574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ca32a-a2be-44ba-979e-145d4dcfaf05 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.082914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 766/1555] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:14.088651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 790/1556] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:14.088651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fac5b-73ae-44f3-9d23-7df79f251194 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.088651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fac5b-73ae-44f3-9d23-7df79f251194 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.088965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00392b-5e10-452c-83f6-e97ed3882aa3 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.089047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fac5b-73ae-44f3-9d23-7df79f251194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.089129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00392b-5e10-452c-83f6-e97ed3882aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.089129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00392b-5e10-452c-83f6-e97ed3882aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.106533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-037fac5b-73ae-44f3-9d23-7df79f251194 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:14.107728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-fd00392b-5e10-452c-83f6-e97ed3882aa3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:14.107841 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-037fac5b-73ae-44f3-9d23-7df79f251194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:14.108910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fd00392b-5e10-452c-83f6-e97ed3882aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:14.115845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 791/1557] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.117054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282a33-18c2-4d87-9330-b8b0dda807fe None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.117339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282a33-18c2-4d87-9330-b8b0dda807fe None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.117702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a282a33-18c2-4d87-9330-b8b0dda807fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.119008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 767/1558] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.119961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00392b-5e10-452c-83f6-e97ed3882aa3 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.130434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00392b-5e10-452c-83f6-e97ed3882aa3 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.135630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448fe30-eb59-4b9c-89c4-2a0ea64bc117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.136295 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448fe30-eb59-4b9c-89c4-2a0ea64bc117 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.136581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448fe30-eb59-4b9c-89c4-2a0ea64bc117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.136861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448fe30-eb59-4b9c-89c4-2a0ea64bc117 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.137570 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448fe30-eb59-4b9c-89c4-2a0ea64bc117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.138783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-5a282a33-18c2-4d87-9330-b8b0dda807fe None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:14.139562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448fe30-eb59-4b9c-89c4-2a0ea64bc117 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.139968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5a282a33-18c2-4d87-9330-b8b0dda807fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:14.147794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 792/1559] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.149125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03ce7-b341-4b39-aa7f-ee214340092c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.149387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03ce7-b341-4b39-aa7f-ee214340092c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.149680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c03ce7-b341-4b39-aa7f-ee214340092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.158180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:14.164618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 768/1560] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.166548 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d76a8-666b-45ab-9b36-e9b817327919 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.166842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d76a8-666b-45ab-9b36-e9b817327919 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.167440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d76a8-666b-45ab-9b36-e9b817327919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.169013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-23c03ce7-b341-4b39-aa7f-ee214340092c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:14.170230 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-23c03ce7-b341-4b39-aa7f-ee214340092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:14.177902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 793/1561] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.178760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c03ce7-b341-4b39-aa7f-ee214340092c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.185508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bb0d76a8-666b-45ab-9b36-e9b817327919 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:14.186749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bb0d76a8-666b-45ab-9b36-e9b817327919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:14.188084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c03ce7-b341-4b39-aa7f-ee214340092c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.192396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32882835-1a14-4ada-9579-3c6de2a0ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.193037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32882835-1a14-4ada-9579-3c6de2a0ec7e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.193312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32882835-1a14-4ada-9579-3c6de2a0ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.193582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32882835-1a14-4ada-9579-3c6de2a0ec7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.194339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32882835-1a14-4ada-9579-3c6de2a0ec7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.194540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 769/1562] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.195280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d76a8-666b-45ab-9b36-e9b817327919 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.199691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32882835-1a14-4ada-9579-3c6de2a0ec7e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.202430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:14.205038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d76a8-666b-45ab-9b36-e9b817327919 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.210069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29a4b1-9847-474b-9ab7-3916c495043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.210741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a4b1-9847-474b-9ab7-3916c495043d admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.211018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a4b1-9847-474b-9ab7-3916c495043d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.211414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a4b1-9847-474b-9ab7-3916c495043d admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.215678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29a4b1-9847-474b-9ab7-3916c495043d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.215826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 794/1563] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:14.215826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32882835-1a14-4ada-9579-3c6de2a0ec7e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.216018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING py.warnings [None req-ab29a4b1-9847-474b-9ab7-3916c495043d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:38:14.216018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: warnings.warn(msg) Jul 01 19:38:14.216018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: Jul 01 19:38:14.216018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29a4b1-9847-474b-9ab7-3916c495043d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.225101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32882835-1a14-4ada-9579-3c6de2a0ec7e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.230010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.230659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.231022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.231216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.231935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:14.232253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.233310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING py.warnings [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:38:14.233310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: warnings.warn(msg) Jul 01 19:38:14.233310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: Jul 01 19:38:14.234257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.242257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 770/1564] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.243597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eb388-bee8-46a0-9f4a-c8df0d2970f2 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.243884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eb388-bee8-46a0-9f4a-c8df0d2970f2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.244199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eb388-bee8-46a0-9f4a-c8df0d2970f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.254764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 795/1565] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:14.254764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.259870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5de10c-c330-489d-beb3-e3f8703c6787 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.267828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ad3eb388-bee8-46a0-9f4a-c8df0d2970f2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:14.269019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ad3eb388-bee8-46a0-9f4a-c8df0d2970f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:14.314544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.315208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.315493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.315766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.316490 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:14.316794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.318436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.327268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 771/1566] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.328316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eb388-bee8-46a0-9f4a-c8df0d2970f2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.337247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 796/1567] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:14.337247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.337726 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eb388-bee8-46a0-9f4a-c8df0d2970f2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.342325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981706-b263-4c39-b904-1b058a508d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.342963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b06197-0713-4334-a5d4-ebd07367dd9d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.343051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981706-b263-4c39-b904-1b058a508d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.343302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981706-b263-4c39-b904-1b058a508d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.343611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981706-b263-4c39-b904-1b058a508d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.344313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e981706-b263-4c39-b904-1b058a508d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.345916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e981706-b263-4c39-b904-1b058a508d0d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.347213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.347869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.348202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.348476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.349191 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:14.349497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.351105 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.356096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 772/1568] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:14.357169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981706-b263-4c39-b904-1b058a508d0d admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.364119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 797/1569] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:14.364953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.366759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981706-b263-4c39-b904-1b058a508d0d admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.371362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.372066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.372348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.372619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.373332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:14.373632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.375290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.376817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f5771-39a3-4cc6-a981-fcee35f82c33 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.382265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43317a-a9f1-4113-98b5-83ae831ea1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.383209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43317a-a9f1-4113-98b5-83ae831ea1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.383498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43317a-a9f1-4113-98b5-83ae831ea1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.383781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43317a-a9f1-4113-98b5-83ae831ea1d5 admin admin] PATH_INFO: `/v3/projects/21155f0418884af191e3e7981904730c/users/c4167eeb95ca4a95a7db1c8e2491a411/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.387549 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 773/1570] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:14.388340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.397545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe4376-6a7d-4e3e-8d8b-ffc44827b556 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.402036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2173bcd-76dd-4c04-961d-9b7180a5d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.402685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173bcd-76dd-4c04-961d-9b7180a5d399 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.402966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173bcd-76dd-4c04-961d-9b7180a5d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.403249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2173bcd-76dd-4c04-961d-9b7180a5d399 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.403929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2173bcd-76dd-4c04-961d-9b7180a5d399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.405830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2173bcd-76dd-4c04-961d-9b7180a5d399 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.406376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43317a-a9f1-4113-98b5-83ae831ea1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21155f0418884af191e3e7981904730c, user_id=c4167eeb95ca4a95a7db1c8e2491a411, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.409032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43317a-a9f1-4113-98b5-83ae831ea1d5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.424947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 798/1571] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:14 2022] PUT /identity/v3/projects/21155f0418884af191e3e7981904730c/users/c4167eeb95ca4a95a7db1c8e2491a411/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:14.425691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43317a-a9f1-4113-98b5-83ae831ea1d5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.427193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 774/1572] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/users => generated 283 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.427900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2173bcd-76dd-4c04-961d-9b7180a5d399 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.440901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2173bcd-76dd-4c04-961d-9b7180a5d399 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.491048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43317a-a9f1-4113-98b5-83ae831ea1d5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.495588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10419df-b1d4-43b8-b8bc-e423f680f912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.496253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10419df-b1d4-43b8-b8bc-e423f680f912 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.496534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10419df-b1d4-43b8-b8bc-e423f680f912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.496813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10419df-b1d4-43b8-b8bc-e423f680f912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.497379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.497530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10419df-b1d4-43b8-b8bc-e423f680f912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.498267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.498635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.498999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.499424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10419df-b1d4-43b8-b8bc-e423f680f912 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.499906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:14.500302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.501986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.521241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 775/1573] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:14.521241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.524469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23382b0d-35f1-4e07-956a-dd6fbf649278 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.529146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9183-8460-4f42-9456-6f9f32949918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.529780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9183-8460-4f42-9456-6f9f32949918 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.530089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9183-8460-4f42-9456-6f9f32949918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.530362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9183-8460-4f42-9456-6f9f32949918 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.531042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c9183-8460-4f42-9456-6f9f32949918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.532920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c9183-8460-4f42-9456-6f9f32949918 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.536305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 799/1574] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.536305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10419df-b1d4-43b8-b8bc-e423f680f912 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.557535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:14.564716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 776/1575] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.565490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9183-8460-4f42-9456-6f9f32949918 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.569260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:14.603393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10419df-b1d4-43b8-b8bc-e423f680f912 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.631144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9183-8460-4f42-9456-6f9f32949918 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.638495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1175-7b19-4e75-bbc1-fce783f47a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.639222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1175-7b19-4e75-bbc1-fce783f47a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.639506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1175-7b19-4e75-bbc1-fce783f47a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.639784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da1175-7b19-4e75-bbc1-fce783f47a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.640487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1175-7b19-4e75-bbc1-fce783f47a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.642460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da1175-7b19-4e75-bbc1-fce783f47a31 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.659499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3679-8fc7-445c-bdc3-89c5687bf008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.660181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3679-8fc7-445c-bdc3-89c5687bf008 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.660487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3679-8fc7-445c-bdc3-89c5687bf008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.660769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c3679-8fc7-445c-bdc3-89c5687bf008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.661544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c3679-8fc7-445c-bdc3-89c5687bf008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.663199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c3679-8fc7-445c-bdc3-89c5687bf008 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.672371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 777/1576] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.676331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1175-7b19-4e75-bbc1-fce783f47a31 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.676478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 800/1577] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:14.676478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3679-8fc7-445c-bdc3-89c5687bf008 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.684014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c3679-8fc7-445c-bdc3-89c5687bf008 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.738624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe270a8-351d-4415-89bf-261d44c42654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.738867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da1175-7b19-4e75-bbc1-fce783f47a31 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.739295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe270a8-351d-4415-89bf-261d44c42654 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.739703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe270a8-351d-4415-89bf-261d44c42654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.739980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe270a8-351d-4415-89bf-261d44c42654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.740775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe270a8-351d-4415-89bf-261d44c42654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.742417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe270a8-351d-4415-89bf-261d44c42654 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.744008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8c9ad-8676-4118-aad0-84b80a7af4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.744674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8c9ad-8676-4118-aad0-84b80a7af4fd admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.745042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8c9ad-8676-4118-aad0-84b80a7af4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.745312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8c9ad-8676-4118-aad0-84b80a7af4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.746034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8c9ad-8676-4118-aad0-84b80a7af4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.747942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8c9ad-8676-4118-aad0-84b80a7af4fd admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.752373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 801/1578] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:14.753612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249619e-b672-4fcd-af06-8f9ec57f9699 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.753902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249619e-b672-4fcd-af06-8f9ec57f9699 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.754226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249619e-b672-4fcd-af06-8f9ec57f9699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.771554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-3249619e-b672-4fcd-af06-8f9ec57f9699 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:14.772792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3249619e-b672-4fcd-af06-8f9ec57f9699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:14.779099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 778/1579] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.779099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8c9ad-8676-4118-aad0-84b80a7af4fd admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.834429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 802/1580] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:14.835499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249619e-b672-4fcd-af06-8f9ec57f9699 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.839189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8c9ad-8676-4118-aad0-84b80a7af4fd admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.844735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b276238-708c-49ee-be4c-6e261d4e08af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.845406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276238-708c-49ee-be4c-6e261d4e08af admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.845691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276238-708c-49ee-be4c-6e261d4e08af admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.845990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b276238-708c-49ee-be4c-6e261d4e08af admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.846695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b276238-708c-49ee-be4c-6e261d4e08af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.847219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249619e-b672-4fcd-af06-8f9ec57f9699 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.848663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b276238-708c-49ee-be4c-6e261d4e08af admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.851893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb965e83-6ca2-46e8-a6ed-d97218420c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.852567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb965e83-6ca2-46e8-a6ed-d97218420c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.852871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb965e83-6ca2-46e8-a6ed-d97218420c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.853149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb965e83-6ca2-46e8-a6ed-d97218420c80 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.853846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb965e83-6ca2-46e8-a6ed-d97218420c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.855805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb965e83-6ca2-46e8-a6ed-d97218420c80 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.862654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:14.864739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:14.883969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 779/1581] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.883969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b276238-708c-49ee-be4c-6e261d4e08af admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.888186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 803/1582] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.890931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb965e83-6ca2-46e8-a6ed-d97218420c80 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.901847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb965e83-6ca2-46e8-a6ed-d97218420c80 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.944008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b276238-708c-49ee-be4c-6e261d4e08af admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.951046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77198c6-62ac-4f9e-a65e-112acb17b6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.951739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77198c6-62ac-4f9e-a65e-112acb17b6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.952015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77198c6-62ac-4f9e-a65e-112acb17b6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.952278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77198c6-62ac-4f9e-a65e-112acb17b6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.952977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77198c6-62ac-4f9e-a65e-112acb17b6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.954957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77198c6-62ac-4f9e-a65e-112acb17b6f6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.959636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb7677-10c6-4d10-8255-6d54d635b9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.960320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7677-10c6-4d10-8255-6d54d635b9cf admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.960601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7677-10c6-4d10-8255-6d54d635b9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.960879 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb7677-10c6-4d10-8255-6d54d635b9cf admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.961827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb7677-10c6-4d10-8255-6d54d635b9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:14.963640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb7677-10c6-4d10-8255-6d54d635b9cf admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:14.975485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 780/1583] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.976292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77198c6-62ac-4f9e-a65e-112acb17b6f6 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.986112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77198c6-62ac-4f9e-a65e-112acb17b6f6 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:14.990314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 804/1584] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:14 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:14.990314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb7677-10c6-4d10-8255-6d54d635b9cf admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:14.990774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:14.991664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:14.991944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:14.992217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] PATH_INFO: `/v3/projects/66ecca1332d04a0faf9ccbb60f958e22/users/0b4c1e464c194939ac4ead76af5440fe/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:14.998697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb7677-10c6-4d10-8255-6d54d635b9cf admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.003228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2f91-9c78-4c2f-8be0-3303054b016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.003880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2f91-9c78-4c2f-8be0-3303054b016d admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.004156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2f91-9c78-4c2f-8be0-3303054b016d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.004427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2f91-9c78-4c2f-8be0-3303054b016d admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.005152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2f91-9c78-4c2f-8be0-3303054b016d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.006832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2f91-9c78-4c2f-8be0-3303054b016d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.008279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ecca1332d04a0faf9ccbb60f958e22, user_id=0b4c1e464c194939ac4ead76af5440fe, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.009336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING py.warnings [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:38:15.009336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: warnings.warn(msg) Jul 01 19:38:15.009336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: Jul 01 19:38:15.011336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.018140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 805/1585] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.019009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2f91-9c78-4c2f-8be0-3303054b016d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.026455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 781/1586] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:14 2022] PUT /identity/v3/projects/66ecca1332d04a0faf9ccbb60f958e22/users/0b4c1e464c194939ac4ead76af5440fe/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:15.029574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2f91-9c78-4c2f-8be0-3303054b016d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.030773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.089551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425de289-c963-424b-82df-0a1042924fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.090272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de289-c963-424b-82df-0a1042924fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.090556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de289-c963-424b-82df-0a1042924fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.090830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425de289-c963-424b-82df-0a1042924fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.091074 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41f67a-c846-4529-a2ef-ef01c657b3bd admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.091522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425de289-c963-424b-82df-0a1042924fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.093448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425de289-c963-424b-82df-0a1042924fcc admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.094963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c671e-5250-40a6-8267-02a807d98ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.095614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c671e-5250-40a6-8267-02a807d98ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.095898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c671e-5250-40a6-8267-02a807d98ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.096173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c671e-5250-40a6-8267-02a807d98ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.105651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c671e-5250-40a6-8267-02a807d98ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.107144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c671e-5250-40a6-8267-02a807d98ef0 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.115330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 806/1587] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:15 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:15.116384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425de289-c963-424b-82df-0a1042924fcc admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.117484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 782/1588] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:15.118500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c671e-5250-40a6-8267-02a807d98ef0 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.126317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425de289-c963-424b-82df-0a1042924fcc admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.128082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c671e-5250-40a6-8267-02a807d98ef0 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.131405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d6dc2-4cc2-4308-a1e8-cf1e29416a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.131768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6dc2-4cc2-4308-a1e8-cf1e29416a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.132078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6dc2-4cc2-4308-a1e8-cf1e29416a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.132323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6dc2-4cc2-4308-a1e8-cf1e29416a99 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.133022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d6dc2-4cc2-4308-a1e8-cf1e29416a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.133922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486be10b-a461-4f92-82db-40cde77733d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.134181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be10b-a461-4f92-82db-40cde77733d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.134466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be10b-a461-4f92-82db-40cde77733d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.134742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486be10b-a461-4f92-82db-40cde77733d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.135048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d6dc2-4cc2-4308-a1e8-cf1e29416a99 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.135474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486be10b-a461-4f92-82db-40cde77733d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.137323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486be10b-a461-4f92-82db-40cde77733d1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.149235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 783/1589] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.149880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486be10b-a461-4f92-82db-40cde77733d1 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.158244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 807/1590] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:15 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:15.160029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486be10b-a461-4f92-82db-40cde77733d1 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.162159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d6dc2-4cc2-4308-a1e8-cf1e29416a99 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.164918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0897b7-bcf5-4b59-9ca4-58abf927964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.165672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0897b7-bcf5-4b59-9ca4-58abf927964a admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.165976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0897b7-bcf5-4b59-9ca4-58abf927964a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.166253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0897b7-bcf5-4b59-9ca4-58abf927964a admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.166987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0897b7-bcf5-4b59-9ca4-58abf927964a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.168583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0897b7-bcf5-4b59-9ca4-58abf927964a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.171847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d6dc2-4cc2-4308-a1e8-cf1e29416a99 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.176423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52fb8b-6545-40fd-87cc-b18ea12a1a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.177092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fb8b-6545-40fd-87cc-b18ea12a1a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.177379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fb8b-6545-40fd-87cc-b18ea12a1a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.178082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fb8b-6545-40fd-87cc-b18ea12a1a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.178448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52fb8b-6545-40fd-87cc-b18ea12a1a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.179088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 784/1591] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.179869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0897b7-bcf5-4b59-9ca4-58abf927964a admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.180076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52fb8b-6545-40fd-87cc-b18ea12a1a1f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.191724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 808/1592] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.191924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0897b7-bcf5-4b59-9ca4-58abf927964a admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.196619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ac71-4967-4802-858c-def4991b1958 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.196784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926667-93de-44a4-8c28-8926407f4d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.196898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ac71-4967-4802-858c-def4991b1958 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.197285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8ac71-4967-4802-858c-def4991b1958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.197745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926667-93de-44a4-8c28-8926407f4d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.198060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926667-93de-44a4-8c28-8926407f4d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.198550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926667-93de-44a4-8c28-8926407f4d51 admin admin] PATH_INFO: `/v3/projects/854a8db5dead4b34b68bf3cf30b2d8be/users/da2747e2fe664883b4b0f8d44fc477d3/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.217484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f926667-93de-44a4-8c28-8926407f4d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854a8db5dead4b34b68bf3cf30b2d8be, user_id=da2747e2fe664883b4b0f8d44fc477d3, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.219287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8ef8ac71-4967-4802-858c-def4991b1958 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:15.220523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8ef8ac71-4967-4802-858c-def4991b1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:15.220654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f926667-93de-44a4-8c28-8926407f4d51 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.233493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 809/1593] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:15.233493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8ac71-4967-4802-858c-def4991b1958 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.241469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8ac71-4967-4802-858c-def4991b1958 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.244459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 785/1594] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:15 2022] PUT /identity/v3/projects/854a8db5dead4b34b68bf3cf30b2d8be/users/da2747e2fe664883b4b0f8d44fc477d3/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:15.245126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926667-93de-44a4-8c28-8926407f4d51 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.270508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:15.273074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:INSERT=12,keystone:SELECT=88 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:15.326569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada587d7-2fa7-4f69-91aa-e6e3e47da4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.327251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada587d7-2fa7-4f69-91aa-e6e3e47da4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.327556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada587d7-2fa7-4f69-91aa-e6e3e47da4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.327926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada587d7-2fa7-4f69-91aa-e6e3e47da4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.328840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada587d7-2fa7-4f69-91aa-e6e3e47da4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.330565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada587d7-2fa7-4f69-91aa-e6e3e47da4cf admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.334171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926667-93de-44a4-8c28-8926407f4d51 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.340546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7bcb5-9c51-4b6b-9473-b5befea17872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.341426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bcb5-9c51-4b6b-9473-b5befea17872 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.341884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bcb5-9c51-4b6b-9473-b5befea17872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.342351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7bcb5-9c51-4b6b-9473-b5befea17872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.343618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 810/1595] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.343905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7bcb5-9c51-4b6b-9473-b5befea17872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.346052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7bcb5-9c51-4b6b-9473-b5befea17872 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.347185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada587d7-2fa7-4f69-91aa-e6e3e47da4cf admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.357895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada587d7-2fa7-4f69-91aa-e6e3e47da4cf admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.362218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 786/1596] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.363502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7bcb5-9c51-4b6b-9473-b5befea17872 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.368028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b880af-1289-4741-bd90-33fa4c405ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.368791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b880af-1289-4741-bd90-33fa4c405ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.369086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b880af-1289-4741-bd90-33fa4c405ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.369411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b880af-1289-4741-bd90-33fa4c405ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.370401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b880af-1289-4741-bd90-33fa4c405ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.372269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b880af-1289-4741-bd90-33fa4c405ac4 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.377053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7bcb5-9c51-4b6b-9473-b5befea17872 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.384581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.384785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 811/1597] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.385182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.385409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.385675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.386445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.386951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b880af-1289-4741-bd90-33fa4c405ac4 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.388399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.401270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 787/1598] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.402633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b880af-1289-4741-bd90-33fa4c405ac4 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.405190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.406874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:15.407769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3fc8b-944b-4a5f-8f4a-e01883cad83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.408538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3fc8b-944b-4a5f-8f4a-e01883cad83c admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.408868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3fc8b-944b-4a5f-8f4a-e01883cad83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.409148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3fc8b-944b-4a5f-8f4a-e01883cad83c admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.409885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3fc8b-944b-4a5f-8f4a-e01883cad83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.411518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3fc8b-944b-4a5f-8f4a-e01883cad83c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.424118 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 812/1599] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.428411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4fe2d-b6a5-47df-ad05-b94bc4812110 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.428706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4fe2d-b6a5-47df-ad05-b94bc4812110 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.429033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4fe2d-b6a5-47df-ad05-b94bc4812110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.464813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-22e4fe2d-b6a5-47df-ad05-b94bc4812110 None None] MFA Rules not processed for user `da2747e2fe664883b4b0f8d44fc477d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:15.467102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bd3e5-2945-49e0-89fb-b02baa8d2547 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.467372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-22e4fe2d-b6a5-47df-ad05-b94bc4812110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:15.471418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0877-b366-481c-a18c-3ec5ac2430e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.472250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0877-b366-481c-a18c-3ec5ac2430e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.472626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0877-b366-481c-a18c-3ec5ac2430e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.473025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0877-b366-481c-a18c-3ec5ac2430e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.486250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a0877-b366-481c-a18c-3ec5ac2430e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.487867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a0877-b366-481c-a18c-3ec5ac2430e7 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.499689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 788/1600] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:15.500823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0877-b366-481c-a18c-3ec5ac2430e7 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.511935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0877-b366-481c-a18c-3ec5ac2430e7 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.517376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875ad9-eb4e-4469-831c-ea7bbcb2f363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.518125 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875ad9-eb4e-4469-831c-ea7bbcb2f363 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.518404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875ad9-eb4e-4469-831c-ea7bbcb2f363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.518717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61875ad9-eb4e-4469-831c-ea7bbcb2f363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.519493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875ad9-eb4e-4469-831c-ea7bbcb2f363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.521208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61875ad9-eb4e-4469-831c-ea7bbcb2f363 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.544120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 789/1601] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.544120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875ad9-eb4e-4469-831c-ea7bbcb2f363 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.554210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61875ad9-eb4e-4469-831c-ea7bbcb2f363 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.559408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630c7f7-a45a-4d0d-b0ea-c5ffe3f9e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.560522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630c7f7-a45a-4d0d-b0ea-c5ffe3f9e21e admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.560811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630c7f7-a45a-4d0d-b0ea-c5ffe3f9e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.561517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630c7f7-a45a-4d0d-b0ea-c5ffe3f9e21e admin admin] PATH_INFO: `/v3/projects/9bc18901e30b4252988c065baa36be3c/users/b5040520134e464ea1d534767ea8728e/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.580999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 813/1602] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:15.580999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4fe2d-b6a5-47df-ad05-b94bc4812110 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.591081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630c7f7-a45a-4d0d-b0ea-c5ffe3f9e21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc18901e30b4252988c065baa36be3c, user_id=b5040520134e464ea1d534767ea8728e, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.591321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4fe2d-b6a5-47df-ad05-b94bc4812110 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.595341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630c7f7-a45a-4d0d-b0ea-c5ffe3f9e21e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.597212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68fea-a2d4-41a8-a069-239e3166e68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.597892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68fea-a2d4-41a8-a069-239e3166e68d admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.598244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68fea-a2d4-41a8-a069-239e3166e68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.598591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68fea-a2d4-41a8-a069-239e3166e68d admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.599260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c68fea-a2d4-41a8-a069-239e3166e68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.600854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c68fea-a2d4-41a8-a069-239e3166e68d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.612983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 814/1603] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:15.614133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68fea-a2d4-41a8-a069-239e3166e68d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.618967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 790/1604] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:15 2022] PUT /identity/v3/projects/9bc18901e30b4252988c065baa36be3c/users/b5040520134e464ea1d534767ea8728e/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:15.620463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630c7f7-a45a-4d0d-b0ea-c5ffe3f9e21e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.631686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68fea-a2d4-41a8-a069-239e3166e68d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.703484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324887-7002-4749-9a47-d41c3892baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.704623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324887-7002-4749-9a47-d41c3892baad admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.704906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324887-7002-4749-9a47-d41c3892baad admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.705178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01324887-7002-4749-9a47-d41c3892baad admin admin] PATH_INFO: `/v3/projects/d91e55d086c848b98058626ae4be0228/users/953049df38d04e7fa05c3c5f9d753592/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.705648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630c7f7-a45a-4d0d-b0ea-c5ffe3f9e21e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.712555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbd3c7-0ff7-424a-9dd4-74e4581bab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.713899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbd3c7-0ff7-424a-9dd4-74e4581bab0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.714379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbd3c7-0ff7-424a-9dd4-74e4581bab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.714722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbd3c7-0ff7-424a-9dd4-74e4581bab0c admin admin] PATH_INFO: `/v3/projects/bd397adb95a6455b8e78db9b132d865e/users/bf5ff69a857f412fb65dce1b59a22e9d/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.725122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01324887-7002-4749-9a47-d41c3892baad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91e55d086c848b98058626ae4be0228, user_id=953049df38d04e7fa05c3c5f9d753592, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.729361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01324887-7002-4749-9a47-d41c3892baad admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.737148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbd3c7-0ff7-424a-9dd4-74e4581bab0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd397adb95a6455b8e78db9b132d865e, user_id=bf5ff69a857f412fb65dce1b59a22e9d, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.739883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:15.740958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbd3c7-0ff7-424a-9dd4-74e4581bab0c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.744574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:15.748024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 815/1605] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:15 2022] PUT /identity/v3/projects/d91e55d086c848b98058626ae4be0228/users/953049df38d04e7fa05c3c5f9d753592/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:15.757811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324887-7002-4749-9a47-d41c3892baad admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.770900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 791/1606] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:15 2022] PUT /identity/v3/projects/bd397adb95a6455b8e78db9b132d865e/users/bf5ff69a857f412fb65dce1b59a22e9d/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:15.771794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbd3c7-0ff7-424a-9dd4-74e4581bab0c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.835355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01324887-7002-4749-9a47-d41c3892baad admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.847495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbd3c7-0ff7-424a-9dd4-74e4581bab0c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.854356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8399-be91-49dd-85d4-7ea1e1a63d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.855597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8399-be91-49dd-85d4-7ea1e1a63d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.856150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8399-be91-49dd-85d4-7ea1e1a63d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.856684 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8399-be91-49dd-85d4-7ea1e1a63d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.858237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8399-be91-49dd-85d4-7ea1e1a63d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.862239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8399-be91-49dd-85d4-7ea1e1a63d2c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.902629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 792/1607] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:15 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:15.902629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8399-be91-49dd-85d4-7ea1e1a63d2c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:15.921185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263db7a-af6c-4573-bf76-cef8ae9106fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:15.922144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263db7a-af6c-4573-bf76-cef8ae9106fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.922429 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263db7a-af6c-4573-bf76-cef8ae9106fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.922738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263db7a-af6c-4573-bf76-cef8ae9106fa admin admin] PATH_INFO: `/v3/projects/42651dd992524e1fb3aaed0cd268b783/users/889dd7d1ee484c698622dd3dd45b1bd1/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.941708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263db7a-af6c-4573-bf76-cef8ae9106fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=42651dd992524e1fb3aaed0cd268b783, user_id=889dd7d1ee484c698622dd3dd45b1bd1, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:15.944700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263db7a-af6c-4573-bf76-cef8ae9106fa admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:15.964025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 816/1608] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:15 2022] PUT /identity/v3/projects/42651dd992524e1fb3aaed0cd268b783/users/889dd7d1ee484c698622dd3dd45b1bd1/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:15.965345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d075-ca69-4a47-9537-8a385988c30d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:15.965776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d075-ca69-4a47-9537-8a385988c30d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:15.966088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3348d075-ca69-4a47-9537-8a385988c30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:15.984707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8399-be91-49dd-85d4-7ea1e1a63d2c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:15.994507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-3348d075-ca69-4a47-9537-8a385988c30d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:15.995829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3348d075-ca69-4a47-9537-8a385988c30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:16.097044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 817/1609] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:16.099140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9b29-55f3-4dfb-ba38-a0ec8033298d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.099433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9b29-55f3-4dfb-ba38-a0ec8033298d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.099711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9b29-55f3-4dfb-ba38-a0ec8033298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.101609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a94785e-1914-470d-aa5e-61fae622014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.102628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94785e-1914-470d-aa5e-61fae622014c admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.103257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94785e-1914-470d-aa5e-61fae622014c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.103257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a94785e-1914-470d-aa5e-61fae622014c admin admin] PATH_INFO: `/v3/projects/7d037922bcac4bc6babcd8183982073e/users/3229929e0f2f4c9fbb3dc6413b6db151/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.121046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94785e-1914-470d-aa5e-61fae622014c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d037922bcac4bc6babcd8183982073e, user_id=3229929e0f2f4c9fbb3dc6413b6db151, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.124147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a94785e-1914-470d-aa5e-61fae622014c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.140877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b48e9b29-55f3-4dfb-ba38-a0ec8033298d None None] MFA Rules not processed for user `953049df38d04e7fa05c3c5f9d753592`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:16.142732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b48e9b29-55f3-4dfb-ba38-a0ec8033298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:16.150053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 793/1610] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:15 2022] PUT /identity/v3/projects/7d037922bcac4bc6babcd8183982073e/users/3229929e0f2f4c9fbb3dc6413b6db151/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:16.151394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312457d-bedf-4cf1-8938-54490a921789 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.151649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312457d-bedf-4cf1-8938-54490a921789 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.152001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312457d-bedf-4cf1-8938-54490a921789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.172238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:16.193752 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-4312457d-bedf-4cf1-8938-54490a921789 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:16.195014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4312457d-bedf-4cf1-8938-54490a921789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:16.200971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:16.292318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 794/1611] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:16.299358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312457d-bedf-4cf1-8938-54490a921789 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.308976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 818/1612] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:16.308976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e808c-4f4e-461e-ae1b-4465ba7b2630 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.308976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e808c-4f4e-461e-ae1b-4465ba7b2630 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.308976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e808c-4f4e-461e-ae1b-4465ba7b2630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.320439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312457d-bedf-4cf1-8938-54490a921789 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:16.327735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238505-8044-4603-b809-a5d584d03694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.328670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238505-8044-4603-b809-a5d584d03694 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.329122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238505-8044-4603-b809-a5d584d03694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.330449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65238505-8044-4603-b809-a5d584d03694 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.331667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65238505-8044-4603-b809-a5d584d03694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.334765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65238505-8044-4603-b809-a5d584d03694 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.340785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f12e808c-4f4e-461e-ae1b-4465ba7b2630 None None] MFA Rules not processed for user `889dd7d1ee484c698622dd3dd45b1bd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:16.342175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f12e808c-4f4e-461e-ae1b-4465ba7b2630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:16.375174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 795/1613] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:16 2022] POST /identity/v3/users => generated 289 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:16.377197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238505-8044-4603-b809-a5d584d03694 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.416525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 819/1614] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:16.418310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b7b6d-6069-470f-b154-8e7c7f2ec725 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.419037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b7b6d-6069-470f-b154-8e7c7f2ec725 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.419445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b7b6d-6069-470f-b154-8e7c7f2ec725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.439524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-514b7b6d-6069-470f-b154-8e7c7f2ec725 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:16.440931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-514b7b6d-6069-470f-b154-8e7c7f2ec725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:16.454851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 820/1615] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:16.456304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b7b6d-6069-470f-b154-8e7c7f2ec725 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.478627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65238505-8044-4603-b809-a5d584d03694 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:16.484346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec541d3-3062-4230-b578-ee62e7b1d86a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.485238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec541d3-3062-4230-b578-ee62e7b1d86a service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.485519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec541d3-3062-4230-b578-ee62e7b1d86a service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.486006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec541d3-3062-4230-b578-ee62e7b1d86a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.500988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec541d3-3062-4230-b578-ee62e7b1d86a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.503888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec541d3-3062-4230-b578-ee62e7b1d86a service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.517214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 796/1616] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:16.518111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec541d3-3062-4230-b578-ee62e7b1d86a service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.526316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b7b6d-6069-470f-b154-8e7c7f2ec725 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:16.532089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec541d3-3062-4230-b578-ee62e7b1d86a service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:16.532457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1727fb-3e78-4d45-a486-f6ede877296a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.533483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1727fb-3e78-4d45-a486-f6ede877296a service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.534111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1727fb-3e78-4d45-a486-f6ede877296a service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.534704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1727fb-3e78-4d45-a486-f6ede877296a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.538278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62c20b-9ee9-47dd-bb3e-dde8d196fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.539034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62c20b-9ee9-47dd-bb3e-dde8d196fdfe admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.539290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62c20b-9ee9-47dd-bb3e-dde8d196fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.539884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62c20b-9ee9-47dd-bb3e-dde8d196fdfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.540748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62c20b-9ee9-47dd-bb3e-dde8d196fdfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.544212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62c20b-9ee9-47dd-bb3e-dde8d196fdfe admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.547039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1727fb-3e78-4d45-a486-f6ede877296a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.549105 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1727fb-3e78-4d45-a486-f6ede877296a service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.561758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 821/1617] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:16.562942 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1727fb-3e78-4d45-a486-f6ede877296a service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.575933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1727fb-3e78-4d45-a486-f6ede877296a service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:16.583080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1223e4-15de-4a08-97c3-52283784ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.584173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1223e4-15de-4a08-97c3-52283784ae07 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.584547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1223e4-15de-4a08-97c3-52283784ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.585158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1223e4-15de-4a08-97c3-52283784ae07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.585989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1223e4-15de-4a08-97c3-52283784ae07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.589426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1223e4-15de-4a08-97c3-52283784ae07 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.595564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 797/1618] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:16 2022] POST /identity/v3/projects => generated 405 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:16.598305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62c20b-9ee9-47dd-bb3e-dde8d196fdfe admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.603538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 822/1619] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:16.605381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33459-0995-4e83-a9c8-d4773609fe08 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.605829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33459-0995-4e83-a9c8-d4773609fe08 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.606224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33459-0995-4e83-a9c8-d4773609fe08 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.608172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 823/1620] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jul 1 19:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:38:16.609138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e33459-0995-4e83-a9c8-d4773609fe08 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.658611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:16.711237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62c20b-9ee9-47dd-bb3e-dde8d196fdfe admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:16.723344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d276057-efb7-48db-b9e9-be6ec7cee3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.724584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d276057-efb7-48db-b9e9-be6ec7cee3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.724991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d276057-efb7-48db-b9e9-be6ec7cee3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.725667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d276057-efb7-48db-b9e9-be6ec7cee3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.739581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e33459-0995-4e83-a9c8-d4773609fe08 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:16.740703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d276057-efb7-48db-b9e9-be6ec7cee3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.742210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d276057-efb7-48db-b9e9-be6ec7cee3b9 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.755102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 798/1621] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:16.756010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d276057-efb7-48db-b9e9-be6ec7cee3b9 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.756827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aab0b5-8f0b-4834-ad3d-d5e3f087cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.760260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aab0b5-8f0b-4834-ad3d-d5e3f087cc84 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.761014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aab0b5-8f0b-4834-ad3d-d5e3f087cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.762710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aab0b5-8f0b-4834-ad3d-d5e3f087cc84 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.765306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aab0b5-8f0b-4834-ad3d-d5e3f087cc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.769508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d276057-efb7-48db-b9e9-be6ec7cee3b9 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:16.774687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aab0b5-8f0b-4834-ad3d-d5e3f087cc84 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.775518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c856df-46ee-499f-827f-a118397db0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:16.777189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c856df-46ee-499f-827f-a118397db0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.777472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c856df-46ee-499f-827f-a118397db0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.777940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c856df-46ee-499f-827f-a118397db0d4 admin admin] PATH_INFO: `/v3/projects/3bf72f88fd014401914d570ceea39e45/users/10f00733ddaf4aef9edb3e3529825301/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.794012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:16.797825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c856df-46ee-499f-827f-a118397db0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf72f88fd014401914d570ceea39e45, user_id=10f00733ddaf4aef9edb3e3529825301, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:16.802099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c856df-46ee-499f-827f-a118397db0d4 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:16.823957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 824/1622] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:16 2022] POST /identity/v3/users => generated 309 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:16.827927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 799/1623] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:16 2022] PUT /identity/v3/projects/3bf72f88fd014401914d570ceea39e45/users/10f00733ddaf4aef9edb3e3529825301/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:16.828613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c856df-46ee-499f-827f-a118397db0d4 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:16.828982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb18ae-6cef-49dd-bf85-c2a79f837391 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:16.829505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb18ae-6cef-49dd-bf85-c2a79f837391 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:16.830615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb18ae-6cef-49dd-bf85-c2a79f837391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:16.889640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4ffb18ae-6cef-49dd-bf85-c2a79f837391 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:16.892907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4ffb18ae-6cef-49dd-bf85-c2a79f837391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:17.025214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c856df-46ee-499f-827f-a118397db0d4 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.040039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67239ce-e17d-4afa-bf5e-bbdfedb774c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.043884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67239ce-e17d-4afa-bf5e-bbdfedb774c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.044195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67239ce-e17d-4afa-bf5e-bbdfedb774c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.044479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67239ce-e17d-4afa-bf5e-bbdfedb774c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.045249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67239ce-e17d-4afa-bf5e-bbdfedb774c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:17.049810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67239ce-e17d-4afa-bf5e-bbdfedb774c7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:17.091056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 800/1624] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:17.092535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67239ce-e17d-4afa-bf5e-bbdfedb774c7 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:17.123546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67239ce-e17d-4afa-bf5e-bbdfedb774c7 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.125577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 825/1625] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jul 1 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:17.128615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb18ae-6cef-49dd-bf85-c2a79f837391 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:17.139278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd648-e03b-4ce4-9872-6319bd51e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.140456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd648-e03b-4ce4-9872-6319bd51e471 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.140580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd648-e03b-4ce4-9872-6319bd51e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.142084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dd648-e03b-4ce4-9872-6319bd51e471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.145030 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dd648-e03b-4ce4-9872-6319bd51e471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:17.149704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dd648-e03b-4ce4-9872-6319bd51e471 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:17.160518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb18ae-6cef-49dd-bf85-c2a79f837391 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.171698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523a322-b7ef-4262-b474-7ee7c3fa818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.176509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a322-b7ef-4262-b474-7ee7c3fa818f admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.177071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a322-b7ef-4262-b474-7ee7c3fa818f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.177360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6523a322-b7ef-4262-b474-7ee7c3fa818f admin admin] PATH_INFO: `/v3/projects/46f93735d6b0443484a78866db9f0eb4/users/3b11a155ade04cba9e2a72c596139d7f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.179187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 801/1626] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:17.180430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd648-e03b-4ce4-9872-6319bd51e471 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:17.214330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dd648-e03b-4ce4-9872-6319bd51e471 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.218538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523a322-b7ef-4262-b474-7ee7c3fa818f admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f93735d6b0443484a78866db9f0eb4, user_id=3b11a155ade04cba9e2a72c596139d7f, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:17.224813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6523a322-b7ef-4262-b474-7ee7c3fa818f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:17.232360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8984e7-6480-49c6-a1f1-5098d65ddc80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.233385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8984e7-6480-49c6-a1f1-5098d65ddc80 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.234169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8984e7-6480-49c6-a1f1-5098d65ddc80 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.234465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8984e7-6480-49c6-a1f1-5098d65ddc80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.261598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 826/1627] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:17 2022] PUT /identity/v3/projects/46f93735d6b0443484a78866db9f0eb4/users/3b11a155ade04cba9e2a72c596139d7f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:17.262600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523a322-b7ef-4262-b474-7ee7c3fa818f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:17.375348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8984e7-6480-49c6-a1f1-5098d65ddc80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:17.377763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8984e7-6480-49c6-a1f1-5098d65ddc80 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:17.406811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 802/1628] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:17.407762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8984e7-6480-49c6-a1f1-5098d65ddc80 service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:17.408251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6523a322-b7ef-4262-b474-7ee7c3fa818f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.421393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5b005-efb3-42b5-ba49-df4b82e5fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.422386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b005-efb3-42b5-ba49-df4b82e5fee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.422678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b005-efb3-42b5-ba49-df4b82e5fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.422958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5b005-efb3-42b5-ba49-df4b82e5fee6 admin admin] PATH_INFO: `/v3/projects/3bf72f88fd014401914d570ceea39e45/users/10f00733ddaf4aef9edb3e3529825301/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.427494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8984e7-6480-49c6-a1f1-5098d65ddc80 service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.428921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5b005-efb3-42b5-ba49-df4b82e5fee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf72f88fd014401914d570ceea39e45, user_id=10f00733ddaf4aef9edb3e3529825301, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:17.434097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5b005-efb3-42b5-ba49-df4b82e5fee6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:17.440404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ec5e-b75c-4e2c-bedd-9eb7b3ef81ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.442121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ec5e-b75c-4e2c-bedd-9eb7b3ef81ce admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.442409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ec5e-b75c-4e2c-bedd-9eb7b3ef81ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.442694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ec5e-b75c-4e2c-bedd-9eb7b3ef81ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.443496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ec5e-b75c-4e2c-bedd-9eb7b3ef81ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:17.445321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ec5e-b75c-4e2c-bedd-9eb7b3ef81ce admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:17.462758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 803/1629] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:17.463682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ec5e-b75c-4e2c-bedd-9eb7b3ef81ce admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:17.466774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 827/1630] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:17 2022] PUT /identity/v3/projects/3bf72f88fd014401914d570ceea39e45/users/10f00733ddaf4aef9edb3e3529825301/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:17.477259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ec5e-b75c-4e2c-bedd-9eb7b3ef81ce admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.480104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c743216-3721-4c8e-a20c-a337adbe3653 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.480613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c743216-3721-4c8e-a20c-a337adbe3653 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.481091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c743216-3721-4c8e-a20c-a337adbe3653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.530318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-9c743216-3721-4c8e-a20c-a337adbe3653 None None] MFA Rules not processed for user `10f00733ddaf4aef9edb3e3529825301`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:17.531890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9c743216-3721-4c8e-a20c-a337adbe3653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:17.572780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:17.626450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9b3a-7d41-41a9-a225-b8235c8c417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.627880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9b3a-7d41-41a9-a225-b8235c8c417c admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.628575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9b3a-7d41-41a9-a225-b8235c8c417c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.629099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9b3a-7d41-41a9-a225-b8235c8c417c admin admin] PATH_INFO: `/v3/projects/46f93735d6b0443484a78866db9f0eb4/users/3b11a155ade04cba9e2a72c596139d7f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.631986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc9b3a-7d41-41a9-a225-b8235c8c417c admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f93735d6b0443484a78866db9f0eb4, user_id=3b11a155ade04cba9e2a72c596139d7f, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:17.636906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc9b3a-7d41-41a9-a225-b8235c8c417c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:17.645936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:17.653996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 804/1631] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:17 2022] PUT /identity/v3/projects/46f93735d6b0443484a78866db9f0eb4/users/3b11a155ade04cba9e2a72c596139d7f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:17.665117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f38b4-08e7-438d-bef5-7fd1e4dcfa4d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.668047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f38b4-08e7-438d-bef5-7fd1e4dcfa4d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.670310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f38b4-08e7-438d-bef5-7fd1e4dcfa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.721103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 828/1632] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:17.721883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-fc2f38b4-08e7-438d-bef5-7fd1e4dcfa4d None None] MFA Rules not processed for user `3b11a155ade04cba9e2a72c596139d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:17.723205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fc2f38b4-08e7-438d-bef5-7fd1e4dcfa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:17.729893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c743216-3721-4c8e-a20c-a337adbe3653 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:17.805803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c743216-3721-4c8e-a20c-a337adbe3653 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.807257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 805/1633] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:17.821519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3096-8df9-4605-ba39-a5cfc9ea0da8 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.821897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3096-8df9-4605-ba39-a5cfc9ea0da8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.822259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a3096-8df9-4605-ba39-a5cfc9ea0da8 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.824373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 806/1634] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jul 1 19:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:38:17.825540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a3096-8df9-4605-ba39-a5cfc9ea0da8 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:17.949529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f60ed-edcf-4567-9224-b708d5a7c64f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.949529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f60ed-edcf-4567-9224-b708d5a7c64f service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.949529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f60ed-edcf-4567-9224-b708d5a7c64f service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.949529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f60ed-edcf-4567-9224-b708d5a7c64f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.950459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a3096-8df9-4605-ba39-a5cfc9ea0da8 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:17.950459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04609b5b-6e12-4bc4-98b5-d5ffc13679d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:17.950459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04609b5b-6e12-4bc4-98b5-d5ffc13679d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:17.950459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04609b5b-6e12-4bc4-98b5-d5ffc13679d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:17.950952 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04609b5b-6e12-4bc4-98b5-d5ffc13679d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:17.958424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04609b5b-6e12-4bc4-98b5-d5ffc13679d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:17.960101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04609b5b-6e12-4bc4-98b5-d5ffc13679d5 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:18.000547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 807/1635] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:18.003577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70018aee-c3b1-4e88-b8fe-4a66f50e2b9b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:18.004935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70018aee-c3b1-4e88-b8fe-4a66f50e2b9b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:18.005305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70018aee-c3b1-4e88-b8fe-4a66f50e2b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:18.040610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-70018aee-c3b1-4e88-b8fe-4a66f50e2b9b None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:18.041854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-70018aee-c3b1-4e88-b8fe-4a66f50e2b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:18.112916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f60ed-edcf-4567-9224-b708d5a7c64f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:18.113626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f60ed-edcf-4567-9224-b708d5a7c64f service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:18.137440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 829/1636] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:38:18.151269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 808/1637] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:38:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:18.168125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f60ed-edcf-4567-9224-b708d5a7c64f service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:18.178455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f60ed-edcf-4567-9224-b708d5a7c64f service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:18.183362 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f7a98-f1a6-4775-a6c2-e8506623bd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:18.184096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f7a98-f1a6-4775-a6c2-e8506623bd69 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:18.184448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f7a98-f1a6-4775-a6c2-e8506623bd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:18.184789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f7a98-f1a6-4775-a6c2-e8506623bd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:18.199323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f7a98-f1a6-4775-a6c2-e8506623bd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:18.207120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f7a98-f1a6-4775-a6c2-e8506623bd69 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:18.226581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 830/1638] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:18.557273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70018aee-c3b1-4e88-b8fe-4a66f50e2b9b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:18.568829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70018aee-c3b1-4e88-b8fe-4a66f50e2b9b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:18.582770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b517e5d-7605-4f7e-ac94-94fbb4ffae1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:18.583456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517e5d-7605-4f7e-ac94-94fbb4ffae1e service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:18.583742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517e5d-7605-4f7e-ac94-94fbb4ffae1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:18.584014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b517e5d-7605-4f7e-ac94-94fbb4ffae1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:18.622840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:18.697694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b517e5d-7605-4f7e-ac94-94fbb4ffae1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:18.701793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b517e5d-7605-4f7e-ac94-94fbb4ffae1e service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:18.726245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 809/1639] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:19.166725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f7a98-f1a6-4775-a6c2-e8506623bd69 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:19.176457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:19.323412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f7a98-f1a6-4775-a6c2-e8506623bd69 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:19.335853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:19.337108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:19.337689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:19.338144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] PATH_INFO: `/v3/users/953049df38d04e7fa05c3c5f9d753592` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:19.343033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953049df38d04e7fa05c3c5f9d753592)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:19.345324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:19.454402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953049df38d04e7fa05c3c5f9d753592'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:19.478723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953049df38d04e7fa05c3c5f9d753592'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:19.479374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953049df38d04e7fa05c3c5f9d753592'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:19.496093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953049df38d04e7fa05c3c5f9d753592'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:19.526534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8980476b-f4d1-431c-b6d2-95f91d969b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953049df38d04e7fa05c3c5f9d753592'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:19.540294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 831/1640] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:19 2022] DELETE /identity/v3/users/953049df38d04e7fa05c3c5f9d753592 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:19.546930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9895e-d723-4d30-b3d4-afede5e56cde None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:19.547209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9895e-d723-4d30-b3d4-afede5e56cde None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:19.547494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9895e-d723-4d30-b3d4-afede5e56cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:19.581939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f9a9895e-d723-4d30-b3d4-afede5e56cde None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:19.582853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f9a9895e-d723-4d30-b3d4-afede5e56cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:19.714962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 810/1641] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:19.783098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce78f-89c6-4858-b87d-bab48846df75 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:19.783562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce78f-89c6-4858-b87d-bab48846df75 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:19.783685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce78f-89c6-4858-b87d-bab48846df75 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:19.785113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 832/1642] 10.222.0.61 () {54 vars in 961 bytes} [Fri Jul 1 19:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:38:19.794155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ce78f-89c6-4858-b87d-bab48846df75 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:19.795960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f03377-3439-4219-96a9-829132b0e354 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:19.796326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f03377-3439-4219-96a9-829132b0e354 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:19.796589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f03377-3439-4219-96a9-829132b0e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:19.799968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a12ce78f-89c6-4858-b87d-bab48846df75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:19.834735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-41f03377-3439-4219-96a9-829132b0e354 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:19.836233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-41f03377-3439-4219-96a9-829132b0e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:19.910381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ce78f-89c6-4858-b87d-bab48846df75 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:19.915415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eafcef-e1e1-46b9-a35a-a9fde38a4f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:19.916094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eafcef-e1e1-46b9-a35a-a9fde38a4f60 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:19.916379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eafcef-e1e1-46b9-a35a-a9fde38a4f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:19.916658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eafcef-e1e1-46b9-a35a-a9fde38a4f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:19.932007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eafcef-e1e1-46b9-a35a-a9fde38a4f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:19.933873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eafcef-e1e1-46b9-a35a-a9fde38a4f60 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:19.950625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 833/1643] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:19.969321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 811/1644] 10.222.0.61 () {58 vars in 1058 bytes} [Fri Jul 1 19:38:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:19.976085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f50c-5967-4e00-b111-8718e1382ca0 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:19.976559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f50c-5967-4e00-b111-8718e1382ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:19.977194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f50c-5967-4e00-b111-8718e1382ca0 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:19.979151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 834/1645] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jul 1 19:38:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:38:19.986522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c3f3-34cb-481c-acda-8f73be227dea None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:19.986522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c3f3-34cb-481c-acda-8f73be227dea None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:19.986522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac6c3f3-34cb-481c-acda-8f73be227dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:20.009813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-cac6c3f3-34cb-481c-acda-8f73be227dea None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:20.011193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cac6c3f3-34cb-481c-acda-8f73be227dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:20.022237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 812/1646] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:38:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:20.041545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f50c-5967-4e00-b111-8718e1382ca0 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:20.043982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1cc1f50c-5967-4e00-b111-8718e1382ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:20.083778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:20.124001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f50c-5967-4e00-b111-8718e1382ca0 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:20.128708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d54e7-10f1-4df7-a8b0-52d086cf6daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:20.129805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d54e7-10f1-4df7-a8b0-52d086cf6daa service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:20.129805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d54e7-10f1-4df7-a8b0-52d086cf6daa service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:20.130083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d54e7-10f1-4df7-a8b0-52d086cf6daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:20.147122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d54e7-10f1-4df7-a8b0-52d086cf6daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:20.148950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d54e7-10f1-4df7-a8b0-52d086cf6daa service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:20.179172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 835/1647] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:22.167895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6c3f3-34cb-481c-acda-8f73be227dea None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:22.174108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cac6c3f3-34cb-481c-acda-8f73be227dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:22.198959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac6c3f3-34cb-481c-acda-8f73be227dea None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:22.212410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:22.215382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:22.215815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:22.216275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] PATH_INFO: `/v3/projects/d91e55d086c848b98058626ae4be0228` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:22.217939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91e55d086c848b98058626ae4be0228)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:22.221774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:22.283840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:22.297484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91e55d086c848b98058626ae4be0228', 'request_id': 'req-1e8725a7-e346-400d-b580-c6fc332b1af6'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.316703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91e55d086c848b98058626ae4be0228', 'request_id': 'req-1e8725a7-e346-400d-b580-c6fc332b1af6'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.336417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91e55d086c848b98058626ae4be0228', 'request_id': 'req-1e8725a7-e346-400d-b580-c6fc332b1af6'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.368868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] The token cache is being invalidate because project d91e55d086c848b98058626ae4be0228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:22.369856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.371889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.378315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 813/1648] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:22 2022] DELETE /identity/v3/projects/d91e55d086c848b98058626ae4be0228 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:22.382709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d54e7-10f1-4df7-a8b0-52d086cf6daa service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:22.405443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d54e7-10f1-4df7-a8b0-52d086cf6daa service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:22.519933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:22.521401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:22.521908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:22.522440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] PATH_INFO: `/v3/users/3b11a155ade04cba9e2a72c596139d7f` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:22.524199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b11a155ade04cba9e2a72c596139d7f)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:22.526415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:22.628753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b11a155ade04cba9e2a72c596139d7f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.656687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b11a155ade04cba9e2a72c596139d7f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.657314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b11a155ade04cba9e2a72c596139d7f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.667824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b11a155ade04cba9e2a72c596139d7f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.694185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1db9b822-585a-4c17-a5bd-43284921e58f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b11a155ade04cba9e2a72c596139d7f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:22.710187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:22.712022 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:22.715604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 836/1649] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:22 2022] DELETE /identity/v3/users/3b11a155ade04cba9e2a72c596139d7f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:22.726777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8725a7-e346-400d-b580-c6fc332b1af6 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:22.844651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:22.847421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:22.847907 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:22.850162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] PATH_INFO: `/v3/users/da2747e2fe664883b4b0f8d44fc477d3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:22.851897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=da2747e2fe664883b4b0f8d44fc477d3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:22.856327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: WARNING py.warnings [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:38:22.856327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: warnings.warn(msg) Jul 01 19:38:22.856327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: Jul 01 19:38:22.858126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:23.034824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da2747e2fe664883b4b0f8d44fc477d3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:23.036816 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da2747e2fe664883b4b0f8d44fc477d3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:23.060340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da2747e2fe664883b4b0f8d44fc477d3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:23.102146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da2747e2fe664883b4b0f8d44fc477d3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:23.197818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da2747e2fe664883b4b0f8d44fc477d3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:23.231458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 814/1650] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:22 2022] DELETE /identity/v3/users/da2747e2fe664883b4b0f8d44fc477d3 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:38:23.236205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f45f37-1791-4d5e-a591-df056c28bc2f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:23.236855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f45f37-1791-4d5e-a591-df056c28bc2f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:23.237280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f45f37-1791-4d5e-a591-df056c28bc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:23.273859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-35f45f37-1791-4d5e-a591-df056c28bc2f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:23.279864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-35f45f37-1791-4d5e-a591-df056c28bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:23.430039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:23.498623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 837/1651] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:23.554837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:23.556900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:23.703809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:23.730850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b13e2-93d4-4ac6-9264-e9d45f02f7ff admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:23.740517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15b7d5-f129-4b04-aa4e-d9508f82796d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:23.741674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b7d5-f129-4b04-aa4e-d9508f82796d service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:23.742225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b7d5-f129-4b04-aa4e-d9508f82796d service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:23.742829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b7d5-f129-4b04-aa4e-d9508f82796d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:23.759714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15b7d5-f129-4b04-aa4e-d9508f82796d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:23.762475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15b7d5-f129-4b04-aa4e-d9508f82796d service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:23.806639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 815/1652] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:25.395843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f45f37-1791-4d5e-a591-df056c28bc2f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:25.398557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-35f45f37-1791-4d5e-a591-df056c28bc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:25.422630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f45f37-1791-4d5e-a591-df056c28bc2f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:25.454639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:25.455951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:25.456387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:25.456844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] PATH_INFO: `/v3/projects/46f93735d6b0443484a78866db9f0eb4` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:25.458724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f93735d6b0443484a78866db9f0eb4)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:25.460765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: WARNING py.warnings [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:38:25.460765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: warnings.warn(msg) Jul 01 19:38:25.460765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: Jul 01 19:38:25.467197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:25.607944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f93735d6b0443484a78866db9f0eb4', 'request_id': 'req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:25.625967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f93735d6b0443484a78866db9f0eb4', 'request_id': 'req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:25.658223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f93735d6b0443484a78866db9f0eb4', 'request_id': 'req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:25.707893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] The token cache is being invalidate because project 46f93735d6b0443484a78866db9f0eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:25.709568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:25.711431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bf82be3b-ec2d-4760-8a08-3aa0313f67c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:25.717012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 838/1653] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:25 2022] DELETE /identity/v3/projects/46f93735d6b0443484a78866db9f0eb4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:25.722015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996fac-b183-4084-a28b-3948405c9baf None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:25.722586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996fac-b183-4084-a28b-3948405c9baf None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:25.722586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996fac-b183-4084-a28b-3948405c9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:25.755689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a1996fac-b183-4084-a28b-3948405c9baf None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:25.757466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a1996fac-b183-4084-a28b-3948405c9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:25.923251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 816/1654] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:25.926208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8fbf9-f808-4e19-bea3-e0b86f33f977 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:25.926654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8fbf9-f808-4e19-bea3-e0b86f33f977 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:25.927587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8fbf9-f808-4e19-bea3-e0b86f33f977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:25.983821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-bbe8fbf9-f808-4e19-bea3-e0b86f33f977 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:25.985219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bbe8fbf9-f808-4e19-bea3-e0b86f33f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:26.001995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 839/1655] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:26.004164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996fac-b183-4084-a28b-3948405c9baf None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:26.014125 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996fac-b183-4084-a28b-3948405c9baf None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:26.037927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:26.038663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:26.039636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:26.039636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:26.039992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:26.040303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:26.041979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:26.089623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 817/1656] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:26.092722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8fbf9-f808-4e19-bea3-e0b86f33f977 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:26.108067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8fbf9-f808-4e19-bea3-e0b86f33f977 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:26.120909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b994e-46a0-404b-88a3-8dadd0188487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:26.123548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b994e-46a0-404b-88a3-8dadd0188487 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:26.123953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b994e-46a0-404b-88a3-8dadd0188487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:26.125179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b994e-46a0-404b-88a3-8dadd0188487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:26.143465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b994e-46a0-404b-88a3-8dadd0188487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:26.160169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b994e-46a0-404b-88a3-8dadd0188487 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:26.265585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 840/1657] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:26 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:26.274925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:26.285807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01638f5-ac78-443d-9bf1-e13b8e72a8f4 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:26.512381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a0d13-acd4-4918-a835-00566287927e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:26.513098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0d13-acd4-4918-a835-00566287927e admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:26.513381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0d13-acd4-4918-a835-00566287927e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:26.513663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a0d13-acd4-4918-a835-00566287927e admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:26.514461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a0d13-acd4-4918-a835-00566287927e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:26.516386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a0d13-acd4-4918-a835-00566287927e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:26.592986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 818/1658] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:26 2022] POST /identity/v3/users => generated 285 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:26.594698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b994e-46a0-404b-88a3-8dadd0188487 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:26.619004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b994e-46a0-404b-88a3-8dadd0188487 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:26.664621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b7c72-73ab-4530-b667-1180778b497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:26.685348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b7c72-73ab-4530-b667-1180778b497e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:26.688690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b7c72-73ab-4530-b667-1180778b497e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:26.689371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b7c72-73ab-4530-b667-1180778b497e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:26.690616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b7c72-73ab-4530-b667-1180778b497e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:26.712575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307b7c72-73ab-4530-b667-1180778b497e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:26.746112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 841/1659] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:26.746567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a0d13-acd4-4918-a835-00566287927e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:26.759889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a0d13-acd4-4918-a835-00566287927e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:26.787639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50324067-1740-4c36-82dd-1ac90033292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:26.788598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324067-1740-4c36-82dd-1ac90033292f admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:26.789028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324067-1740-4c36-82dd-1ac90033292f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:26.789470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50324067-1740-4c36-82dd-1ac90033292f admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:26.790557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324067-1740-4c36-82dd-1ac90033292f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:26.792378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50324067-1740-4c36-82dd-1ac90033292f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:26.837415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 819/1660] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:26.838688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b7c72-73ab-4530-b667-1180778b497e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:26.855255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307b7c72-73ab-4530-b667-1180778b497e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:26.867580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbcc9d-3ac6-4839-acd9-fd74aaadb539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:26.868857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbcc9d-3ac6-4839-acd9-fd74aaadb539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:26.869357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbcc9d-3ac6-4839-acd9-fd74aaadb539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:26.869833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbcc9d-3ac6-4839-acd9-fd74aaadb539 admin admin] PATH_INFO: `/v3/projects/525838fc50d64ee88b2cce6f75127a39/users/3189019801b54fbbb71e4e72419e93ad/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:26.909330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbcc9d-3ac6-4839-acd9-fd74aaadb539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525838fc50d64ee88b2cce6f75127a39, user_id=3189019801b54fbbb71e4e72419e93ad, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:26.915941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbcc9d-3ac6-4839-acd9-fd74aaadb539 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:26.961845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 842/1661] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:26 2022] PUT /identity/v3/projects/525838fc50d64ee88b2cce6f75127a39/users/3189019801b54fbbb71e4e72419e93ad/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:38:26.963831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e23511-fa1f-4372-9db3-463a8a5625a6 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:26.970334 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e23511-fa1f-4372-9db3-463a8a5625a6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:26.970774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e23511-fa1f-4372-9db3-463a8a5625a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:27.061938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-64e23511-fa1f-4372-9db3-463a8a5625a6 None None] MFA Rules not processed for user `3189019801b54fbbb71e4e72419e93ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:27.063245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-64e23511-fa1f-4372-9db3-463a8a5625a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:27.174679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:27.226139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 820/1662] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:27.230852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbcc9d-3ac6-4839-acd9-fd74aaadb539 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:27.336604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbcc9d-3ac6-4839-acd9-fd74aaadb539 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:27.341713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:27.342560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:27.343001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:27.343385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:27.347385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:27.349500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:27.361401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:27.404586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e23511-fa1f-4372-9db3-463a8a5625a6 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:27.405157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 843/1663] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:27 2022] POST /identity/v3/projects => generated 369 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:27.427545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e23511-fa1f-4372-9db3-463a8a5625a6 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:27.553995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e844c26-87c3-4171-bfa1-a6a532949fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:27.554452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e844c26-87c3-4171-bfa1-a6a532949fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:27.554742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e844c26-87c3-4171-bfa1-a6a532949fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:27.555201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e844c26-87c3-4171-bfa1-a6a532949fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:27.556056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e844c26-87c3-4171-bfa1-a6a532949fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:27.559582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e844c26-87c3-4171-bfa1-a6a532949fd9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:27.616501 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 821/1664] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:27 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:38:27.617734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:27.621436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:27.627849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e844c26-87c3-4171-bfa1-a6a532949fd9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:27.654543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366e7e7-bd86-47f8-8175-54021a5583b7 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:27.674873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e844c26-87c3-4171-bfa1-a6a532949fd9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:27.678874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:27.679750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:27.680092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:27.680380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] PATH_INFO: `/v3/projects/854a8db5dead4b34b68bf3cf30b2d8be` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:27.691772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=854a8db5dead4b34b68bf3cf30b2d8be)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:27.695300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:27.701904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d6784-a96a-48de-8074-4e09ea723eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:27.705188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d6784-a96a-48de-8074-4e09ea723eef admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:27.705635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d6784-a96a-48de-8074-4e09ea723eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:27.705884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d6784-a96a-48de-8074-4e09ea723eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:27.714717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d6784-a96a-48de-8074-4e09ea723eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:27.723109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d6784-a96a-48de-8074-4e09ea723eef admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:27.776784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 822/1665] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:38:27.777780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d6784-a96a-48de-8074-4e09ea723eef admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:27.813866 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d6784-a96a-48de-8074-4e09ea723eef admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:27.829884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:27.833165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:27.833410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:27.834911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] PATH_INFO: `/v3/projects/7fb248fa67784f1ca066331420c50edb/users/9f73385d465e4fa5a68057c03a6986d1/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:27.846362 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854a8db5dead4b34b68bf3cf30b2d8be', 'request_id': 'req-724e105b-f469-4fe4-a877-79f5796ca49d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:27.871862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb248fa67784f1ca066331420c50edb, user_id=9f73385d465e4fa5a68057c03a6986d1, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:27.875687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:27.875991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854a8db5dead4b34b68bf3cf30b2d8be', 'request_id': 'req-724e105b-f469-4fe4-a877-79f5796ca49d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:27.882880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854a8db5dead4b34b68bf3cf30b2d8be', 'request_id': 'req-724e105b-f469-4fe4-a877-79f5796ca49d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:27.909814 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] The token cache is being invalidate because project 854a8db5dead4b34b68bf3cf30b2d8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:27.910053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:27.910720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:27.916148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 844/1666] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:27 2022] DELETE /identity/v3/projects/854a8db5dead4b34b68bf3cf30b2d8be => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:27.921401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 823/1667] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:27 2022] PUT /identity/v3/projects/7fb248fa67784f1ca066331420c50edb/users/9f73385d465e4fa5a68057c03a6986d1/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:27.921774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:27.922389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:27.923264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:27.927221 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:28.081487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e105b-f469-4fe4-a877-79f5796ca49d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:28.096410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:28.097326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:28.097670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:28.097863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] PATH_INFO: `/v3/users/10f00733ddaf4aef9edb3e3529825301` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:28.102899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f00733ddaf4aef9edb3e3529825301)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:28.104878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:28.108812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0290b-b387-4dfc-b5c1-5311ed264246 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:28.123833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b9d35-7cac-4a51-a941-0f145d731ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:28.124542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9d35-7cac-4a51-a941-0f145d731ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:28.124836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9d35-7cac-4a51-a941-0f145d731ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:28.125113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b9d35-7cac-4a51-a941-0f145d731ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:28.129608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9d35-7cac-4a51-a941-0f145d731ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:28.135214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b9d35-7cac-4a51-a941-0f145d731ca3 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:28.184733 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 824/1668] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:28.187720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae073-9a8d-4a55-af4c-047a977a0f9a None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:28.188024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae073-9a8d-4a55-af4c-047a977a0f9a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:28.190686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae073-9a8d-4a55-af4c-047a977a0f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:28.268325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-66bae073-9a8d-4a55-af4c-047a977a0f9a None None] MFA Rules not processed for user `3229929e0f2f4c9fbb3dc6413b6db151`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:28.269835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-66bae073-9a8d-4a55-af4c-047a977a0f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:28.282953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f00733ddaf4aef9edb3e3529825301'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:28.305410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f00733ddaf4aef9edb3e3529825301'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:28.306757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f00733ddaf4aef9edb3e3529825301'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:28.326189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:28.338331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f00733ddaf4aef9edb3e3529825301'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:28.357904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:28.360797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f00733ddaf4aef9edb3e3529825301'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:28.373656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 845/1669] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:27 2022] DELETE /identity/v3/users/10f00733ddaf4aef9edb3e3529825301 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:28.373656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:28.375512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:28.420263 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 825/1670] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:28.428889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae073-9a8d-4a55-af4c-047a977a0f9a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:28.431154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-66bae073-9a8d-4a55-af4c-047a977a0f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:28.515911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00d7ae-86c0-4c35-bae2-101091abb4c0 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:28.526309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecdcab-0848-46fd-83af-7381065b0f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:28.529641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecdcab-0848-46fd-83af-7381065b0f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:28.531775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecdcab-0848-46fd-83af-7381065b0f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:28.532092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecdcab-0848-46fd-83af-7381065b0f1f admin admin] PATH_INFO: `/v3/projects/7fb248fa67784f1ca066331420c50edb/users/9f73385d465e4fa5a68057c03a6986d1/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:28.535242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecdcab-0848-46fd-83af-7381065b0f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb248fa67784f1ca066331420c50edb, user_id=9f73385d465e4fa5a68057c03a6986d1, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:28.538643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecdcab-0848-46fd-83af-7381065b0f1f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:28.567603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 846/1671] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:28 2022] PUT /identity/v3/projects/7fb248fa67784f1ca066331420c50edb/users/9f73385d465e4fa5a68057c03a6986d1/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:28.569966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd349d5-8e74-4035-899b-f14004dfc1d0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:28.570274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd349d5-8e74-4035-899b-f14004dfc1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:28.570758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd349d5-8e74-4035-899b-f14004dfc1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:28.616343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae073-9a8d-4a55-af4c-047a977a0f9a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:28.645114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-bfd349d5-8e74-4035-899b-f14004dfc1d0 None None] MFA Rules not processed for user `9f73385d465e4fa5a68057c03a6986d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:28.647550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bfd349d5-8e74-4035-899b-f14004dfc1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:28.762385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:28.803040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:28.804537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:28.806436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:28.809070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 847/1672] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:28.810355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a53dec-f696-496d-940b-615de1d5bd46 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:28.810642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a53dec-f696-496d-940b-615de1d5bd46 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:28.810920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a53dec-f696-496d-940b-615de1d5bd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:28.867817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-82a53dec-f696-496d-940b-615de1d5bd46 None None] MFA Rules not processed for user `c4167eeb95ca4a95a7db1c8e2491a411`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:28.869259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-82a53dec-f696-496d-940b-615de1d5bd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:28.996848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:28.998953 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:29.003873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:29.019019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 826/1673] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:29.020291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:29.023229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:29.112443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 848/1674] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:29.124007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a53dec-f696-496d-940b-615de1d5bd46 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:29.125471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-82a53dec-f696-496d-940b-615de1d5bd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:29.150507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:29.172995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a53dec-f696-496d-940b-615de1d5bd46 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:29.196734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:29.197416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:29.197699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:29.197990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:29.231515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:29.234646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:29.247011 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413347c4-bf95-4136-b786-9f50842ee939 service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:29.256455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:29.257131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:29.257414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:29.257695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:29.264787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 849/1675] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:29.281641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:29.284153 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:29.320244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 827/1676] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:29 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:29.389300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:29.390797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:29.413652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb1fd-7e7d-46e0-9ac3-8f9374834f7c service nova] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:29.426611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28181ea8-d6fc-44be-a80c-96bd3a766eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:29.427467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28181ea8-d6fc-44be-a80c-96bd3a766eaf service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:29.427753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28181ea8-d6fc-44be-a80c-96bd3a766eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:29.428031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28181ea8-d6fc-44be-a80c-96bd3a766eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:29.430307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-28181ea8-d6fc-44be-a80c-96bd3a766eaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:29.647105 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28181ea8-d6fc-44be-a80c-96bd3a766eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:29.649549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28181ea8-d6fc-44be-a80c-96bd3a766eaf service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:29.698167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 850/1677] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:30.284111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:30.286473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:30.399718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719744-a48e-4957-9ece-35f0eab2b808 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:30.400078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719744-a48e-4957-9ece-35f0eab2b808 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:30.400427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d719744-a48e-4957-9ece-35f0eab2b808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:30.460056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ccaf9-98f9-4a61-90cc-b3deaa5f0463 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:30.471596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:30.472625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:30.473015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:30.473485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] PATH_INFO: `/v3/projects/3bf72f88fd014401914d570ceea39e45` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:30.479108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf72f88fd014401914d570ceea39e45)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:30.486020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:30.527322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-3d719744-a48e-4957-9ece-35f0eab2b808 None None] MFA Rules not processed for user `bf5ff69a857f412fb65dce1b59a22e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:30.529058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3d719744-a48e-4957-9ece-35f0eab2b808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:30.610279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf72f88fd014401914d570ceea39e45', 'request_id': 'req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:30.635872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf72f88fd014401914d570ceea39e45', 'request_id': 'req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:30.646542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 851/1678] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:30.656954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250eec-187b-47a2-bf29-119ec761f6dd None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:30.657572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250eec-187b-47a2-bf29-119ec761f6dd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:30.657677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf72f88fd014401914d570ceea39e45', 'request_id': 'req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:30.658764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c250eec-187b-47a2-bf29-119ec761f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:30.674030 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] The token cache is being invalidate because project 3bf72f88fd014401914d570ceea39e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:30.674480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:30.675289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9eeeca25-3b90-4ef6-a71d-3fed9edf0fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:30.682178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 828/1679] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:30 2022] DELETE /identity/v3/projects/3bf72f88fd014401914d570ceea39e45 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:38:30.685330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6c789-bdb7-4082-bed3-a23d569c04d5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:30.685740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6c789-bdb7-4082-bed3-a23d569c04d5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:30.686258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6c789-bdb7-4082-bed3-a23d569c04d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:30.701285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4c250eec-187b-47a2-bf29-119ec761f6dd None None] MFA Rules not processed for user `bf5ff69a857f412fb65dce1b59a22e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:30.705919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4c250eec-187b-47a2-bf29-119ec761f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:30.733503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-4ef6c789-bdb7-4082-bed3-a23d569c04d5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:30.737093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4ef6c789-bdb7-4082-bed3-a23d569c04d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:30.842264 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:30.926683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 852/1680] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:30.935518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c250eec-187b-47a2-bf29-119ec761f6dd None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:30.946443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4c250eec-187b-47a2-bf29-119ec761f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:31.022605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 829/1681] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:31.024337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c4c67-27be-4549-a55f-c32a9a82e759 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.033889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c4c67-27be-4549-a55f-c32a9a82e759 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.033889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c4c67-27be-4549-a55f-c32a9a82e759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.101543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:31.134062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-296c4c67-27be-4549-a55f-c32a9a82e759 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:31.138632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-296c4c67-27be-4549-a55f-c32a9a82e759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:31.186919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 830/1682] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:31.199334 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c4c67-27be-4549-a55f-c32a9a82e759 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:31.221780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c4c67-27be-4549-a55f-c32a9a82e759 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:31.236048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:31.236765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.237056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.239132 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.239682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:31.239944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:31.244313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:31.284780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c250eec-187b-47a2-bf29-119ec761f6dd None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:31.290801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 831/1683] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:31.294034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:31.320759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:31.322153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.322443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.322722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.323827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3546e-8748-4d43-90d3-5a6ecd58dfdf admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:31.339366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb84a3-278c-4afc-9ba8-60c29dff52fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:31.339985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:31.341000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb84a3-278c-4afc-9ba8-60c29dff52fb admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.343021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb84a3-278c-4afc-9ba8-60c29dff52fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.343563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb84a3-278c-4afc-9ba8-60c29dff52fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.346134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb84a3-278c-4afc-9ba8-60c29dff52fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:31.353034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbb84a3-278c-4afc-9ba8-60c29dff52fb admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:31.382234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:31.387403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:31.422509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 853/1684] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:31.436426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 832/1685] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:31 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:31.437915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:31.455811 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee213a9-314f-4dc1-b9e7-ab9c1392e1d2 service nova] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:31.638820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4aee3-9ecd-4170-8729-a93e38a4311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:31.640005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4aee3-9ecd-4170-8729-a93e38a4311e admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.641687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4aee3-9ecd-4170-8729-a93e38a4311e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.642000 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4aee3-9ecd-4170-8729-a93e38a4311e admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.644376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4aee3-9ecd-4170-8729-a93e38a4311e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:31.649629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4aee3-9ecd-4170-8729-a93e38a4311e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:31.700149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 854/1686] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:31 2022] POST /identity/v3/users => generated 284 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:31.701857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb84a3-278c-4afc-9ba8-60c29dff52fb admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:31.717123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb84a3-278c-4afc-9ba8-60c29dff52fb admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:31.724877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113cadd-1c6a-4a0d-97cf-1bf45f2d3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:31.726513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113cadd-1c6a-4a0d-97cf-1bf45f2d3f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.726884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113cadd-1c6a-4a0d-97cf-1bf45f2d3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.727168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113cadd-1c6a-4a0d-97cf-1bf45f2d3f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.727992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113cadd-1c6a-4a0d-97cf-1bf45f2d3f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:31.730452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113cadd-1c6a-4a0d-97cf-1bf45f2d3f67 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:31.749225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4aee3-9ecd-4170-8729-a93e38a4311e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:31.761230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 833/1687] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:38:31.762845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4aee3-9ecd-4170-8729-a93e38a4311e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:31.768061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4f4b1-69b7-4a9a-9296-5641e4ae8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:31.768861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4f4b1-69b7-4a9a-9296-5641e4ae8e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.769266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4f4b1-69b7-4a9a-9296-5641e4ae8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.769649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4f4b1-69b7-4a9a-9296-5641e4ae8e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.770563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4f4b1-69b7-4a9a-9296-5641e4ae8e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:31.772852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4f4b1-69b7-4a9a-9296-5641e4ae8e9b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:31.794279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113cadd-1c6a-4a0d-97cf-1bf45f2d3f67 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:31.803362 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 855/1688] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:38:31.807889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113cadd-1c6a-4a0d-97cf-1bf45f2d3f67 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:31.812992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05d73c-c392-45d4-b8a4-0fc46d0ce1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:31.814011 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d73c-c392-45d4-b8a4-0fc46d0ce1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.814732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d73c-c392-45d4-b8a4-0fc46d0ce1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.815021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d73c-c392-45d4-b8a4-0fc46d0ce1f0 admin admin] PATH_INFO: `/v3/projects/dbc6f0cbc8d74da2ae293a955e5cdffb/users/543542a9fb6140aa8bd10b1a49e0488f/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.833271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05d73c-c392-45d4-b8a4-0fc46d0ce1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc6f0cbc8d74da2ae293a955e5cdffb, user_id=543542a9fb6140aa8bd10b1a49e0488f, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:31.837647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05d73c-c392-45d4-b8a4-0fc46d0ce1f0 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:31.873101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46f988-91e4-496f-ba0f-2ce3def8a98d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:31.873383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46f988-91e4-496f-ba0f-2ce3def8a98d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:31.873665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46f988-91e4-496f-ba0f-2ce3def8a98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:31.898185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 834/1689] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:31 2022] PUT /identity/v3/projects/dbc6f0cbc8d74da2ae293a955e5cdffb/users/543542a9fb6140aa8bd10b1a49e0488f/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:31.958115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-dc46f988-91e4-496f-ba0f-2ce3def8a98d None None] MFA Rules not processed for user `543542a9fb6140aa8bd10b1a49e0488f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:31.971391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-dc46f988-91e4-496f-ba0f-2ce3def8a98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:32.139431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 856/1690] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:32.145477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05d73c-c392-45d4-b8a4-0fc46d0ce1f0 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:32.351843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05d73c-c392-45d4-b8a4-0fc46d0ce1f0 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:32.377865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:32.378770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:32.381925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:32.382999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:32.385455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:32.390715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:32.492814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 835/1691] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:32 2022] POST /identity/v3/projects => generated 367 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:32.494100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46f988-91e4-496f-ba0f-2ce3def8a98d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:32.527086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46f988-91e4-496f-ba0f-2ce3def8a98d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:32.564120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:32.619767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:32.622120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:32.715311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b1930-e09e-43f4-bbc0-4d8e880fc3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:32.716033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b1930-e09e-43f4-bbc0-4d8e880fc3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:32.716327 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b1930-e09e-43f4-bbc0-4d8e880fc3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:32.716614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b1930-e09e-43f4-bbc0-4d8e880fc3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:32.717347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b1930-e09e-43f4-bbc0-4d8e880fc3f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:32.719368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b1930-e09e-43f4-bbc0-4d8e880fc3f5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:32.775348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:32.788636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 857/1692] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:32 2022] POST /identity/v3/users => generated 290 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:32.806030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b1930-e09e-43f4-bbc0-4d8e880fc3f5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:32.851997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b1930-e09e-43f4-bbc0-4d8e880fc3f5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:32.860147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023508c-2b69-489e-8d17-e64e853316ff admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:32.870478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c9985-f043-4f74-ac21-258cc6221fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:32.874305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c9985-f043-4f74-ac21-258cc6221fda admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:32.876529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:32.877618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:32.877904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:32.878173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c9985-f043-4f74-ac21-258cc6221fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:32.878279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] PATH_INFO: `/v3/users/889dd7d1ee484c698622dd3dd45b1bd1` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:32.878646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c9985-f043-4f74-ac21-258cc6221fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:32.879533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c9985-f043-4f74-ac21-258cc6221fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:32.880999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=889dd7d1ee484c698622dd3dd45b1bd1)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:32.887369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c9985-f043-4f74-ac21-258cc6221fda admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:32.887554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:32.913770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 858/1693] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:32.918080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c9985-f043-4f74-ac21-258cc6221fda admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:32.949003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c9985-f043-4f74-ac21-258cc6221fda admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:32.955352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfc24e-dc98-4ed3-870c-9e2029b7a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:32.956543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfc24e-dc98-4ed3-870c-9e2029b7a649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:32.957035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfc24e-dc98-4ed3-870c-9e2029b7a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:32.957462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfc24e-dc98-4ed3-870c-9e2029b7a649 admin admin] PATH_INFO: `/v3/projects/e0aaa3ba67394b9bbb37312b6294885c/users/d42c0a7e9f8247f184e5407f95e44400/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.015681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfc24e-dc98-4ed3-870c-9e2029b7a649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0aaa3ba67394b9bbb37312b6294885c, user_id=d42c0a7e9f8247f184e5407f95e44400, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:33.027539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889dd7d1ee484c698622dd3dd45b1bd1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:33.028157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfc24e-dc98-4ed3-870c-9e2029b7a649 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:33.029496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889dd7d1ee484c698622dd3dd45b1bd1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:33.059026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889dd7d1ee484c698622dd3dd45b1bd1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:33.071282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 859/1694] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:32 2022] PUT /identity/v3/projects/e0aaa3ba67394b9bbb37312b6294885c/users/d42c0a7e9f8247f184e5407f95e44400/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:33.081885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889dd7d1ee484c698622dd3dd45b1bd1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:33.089181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfc24e-dc98-4ed3-870c-9e2029b7a649 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:33.114770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-485f71a5-8a42-459a-b2e9-a9d96e8c8c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889dd7d1ee484c698622dd3dd45b1bd1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:33.136715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 836/1695] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:32 2022] DELETE /identity/v3/users/889dd7d1ee484c698622dd3dd45b1bd1 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:33.141063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47e79-5ee8-4d98-860f-74aa0255a6d8 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:33.141358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47e79-5ee8-4d98-860f-74aa0255a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:33.141639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec47e79-5ee8-4d98-860f-74aa0255a6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.207324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0ec47e79-5ee8-4d98-860f-74aa0255a6d8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:33.208658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0ec47e79-5ee8-4d98-860f-74aa0255a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:33.289536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfc24e-dc98-4ed3-870c-9e2029b7a649 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:33.374878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 837/1696] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:33.453975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34460444-5fed-403d-9290-f74dde40708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:33.454719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34460444-5fed-403d-9290-f74dde40708e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:33.455005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34460444-5fed-403d-9290-f74dde40708e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:33.455286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34460444-5fed-403d-9290-f74dde40708e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.456045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34460444-5fed-403d-9290-f74dde40708e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:33.461554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34460444-5fed-403d-9290-f74dde40708e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:33.486062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 860/1697] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:33.491262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec47e79-5ee8-4d98-860f-74aa0255a6d8 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:33.492847 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0ec47e79-5ee8-4d98-860f-74aa0255a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:33.511882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555edd-920d-445f-9e2b-7373d054230f None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:33.512086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555edd-920d-445f-9e2b-7373d054230f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:33.512325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555edd-920d-445f-9e2b-7373d054230f None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.514066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 861/1698] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jul 1 19:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:38:33.516617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec47e79-5ee8-4d98-860f-74aa0255a6d8 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:33.531814 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971749b-1c87-440e-9a01-50053acde367 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:33.532112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971749b-1c87-440e-9a01-50053acde367 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:33.532379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971749b-1c87-440e-9a01-50053acde367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.538317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:33.539288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:33.539574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:33.539855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] PATH_INFO: `/v3/projects/e0aaa3ba67394b9bbb37312b6294885c/users/d42c0a7e9f8247f184e5407f95e44400/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.549150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0aaa3ba67394b9bbb37312b6294885c, user_id=d42c0a7e9f8247f184e5407f95e44400, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:33.551935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:33.577815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:33.587480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 838/1699] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:33 2022] PUT /identity/v3/projects/e0aaa3ba67394b9bbb37312b6294885c/users/d42c0a7e9f8247f184e5407f95e44400/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:33.588795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:33.596582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:33.626278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8971749b-1c87-440e-9a01-50053acde367 None None] MFA Rules not processed for user `9fcc425392664c17b72fb4655f8fb7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:33.628768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8971749b-1c87-440e-9a01-50053acde367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:33.715480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:33.728861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e283ad6-a9f2-4016-841e-91ec7e4e7eda admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:33.740634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daf3c6-c309-4a5c-981c-f4b430213d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:33.741643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daf3c6-c309-4a5c-981c-f4b430213d11 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:33.743911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daf3c6-c309-4a5c-981c-f4b430213d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:33.746469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daf3c6-c309-4a5c-981c-f4b430213d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.837286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 862/1700] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:38:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:33.838937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e5f6-100f-433e-bdab-b001df9f93f8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:33.839201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e5f6-100f-433e-bdab-b001df9f93f8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:33.839420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271e5f6-100f-433e-bdab-b001df9f93f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:33.949093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b271e5f6-100f-433e-bdab-b001df9f93f8 None None] MFA Rules not processed for user `d42c0a7e9f8247f184e5407f95e44400`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:33.952378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b271e5f6-100f-433e-bdab-b001df9f93f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:34.011059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daf3c6-c309-4a5c-981c-f4b430213d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:34.012560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daf3c6-c309-4a5c-981c-f4b430213d11 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:34.044428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 839/1701] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:34.052729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daf3c6-c309-4a5c-981c-f4b430213d11 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:34.085655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daf3c6-c309-4a5c-981c-f4b430213d11 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:34.112589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:34.113276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:34.113566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:34.113843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:34.138010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:34.150930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:34.181002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 840/1702] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:34.221198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 863/1703] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:34.235272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:34.235963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:34.401998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443316c3-570f-4f18-8f51-a4aaab59ff5b service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:34.410781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63253b9-bff4-4298-b139-9ad1e07a838a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:34.412272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63253b9-bff4-4298-b139-9ad1e07a838a service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:34.412549 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63253b9-bff4-4298-b139-9ad1e07a838a service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:34.418475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63253b9-bff4-4298-b139-9ad1e07a838a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:34.440073 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63253b9-bff4-4298-b139-9ad1e07a838a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:34.441643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63253b9-bff4-4298-b139-9ad1e07a838a service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:34.470327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 841/1704] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:35.259588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271e5f6-100f-433e-bdab-b001df9f93f8 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:35.261411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b271e5f6-100f-433e-bdab-b001df9f93f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:35.297331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271e5f6-100f-433e-bdab-b001df9f93f8 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:35.311670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:35.312852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:35.313282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:35.314073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] PATH_INFO: `/v3/projects/42651dd992524e1fb3aaed0cd268b783` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:35.316307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42651dd992524e1fb3aaed0cd268b783)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:35.317782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:35.560788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42651dd992524e1fb3aaed0cd268b783', 'request_id': 'req-c2e84973-468e-40c9-9042-2bd6422b3657'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:35.585837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42651dd992524e1fb3aaed0cd268b783', 'request_id': 'req-c2e84973-468e-40c9-9042-2bd6422b3657'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:35.610463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42651dd992524e1fb3aaed0cd268b783', 'request_id': 'req-c2e84973-468e-40c9-9042-2bd6422b3657'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:35.645612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] The token cache is being invalidate because project 42651dd992524e1fb3aaed0cd268b783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:35.645961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:35.651809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c2e84973-468e-40c9-9042-2bd6422b3657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:35.657708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071d65-5ab3-4827-b864-ff1b2b7710de None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:35.658666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071d65-5ab3-4827-b864-ff1b2b7710de None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:35.659300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a071d65-5ab3-4827-b864-ff1b2b7710de None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:35.660198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 864/1705] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:35 2022] DELETE /identity/v3/projects/42651dd992524e1fb3aaed0cd268b783 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:35.661239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 842/1706] 10.222.0.61 () {54 vars in 960 bytes} [Fri Jul 1 19:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:38:35.665664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a77e4-8f9c-4d06-8003-e4dee0d8a81c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:35.668197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a77e4-8f9c-4d06-8003-e4dee0d8a81c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:35.668523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a77e4-8f9c-4d06-8003-e4dee0d8a81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:35.669223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d673fe-3dc0-440a-8b2e-ad99a3caa270 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:35.669881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d673fe-3dc0-440a-8b2e-ad99a3caa270 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:35.670458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d673fe-3dc0-440a-8b2e-ad99a3caa270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:35.738123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6a6a77e4-8f9c-4d06-8003-e4dee0d8a81c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:35.739518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6a6a77e4-8f9c-4d06-8003-e4dee0d8a81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:35.767367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-e1d673fe-3dc0-440a-8b2e-ad99a3caa270 None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:35.769654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e1d673fe-3dc0-440a-8b2e-ad99a3caa270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:35.806009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:35.969715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 865/1707] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:35.974592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4583d2f-ea04-4a00-8fd9-c99f8c08955b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:35.974944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4583d2f-ea04-4a00-8fd9-c99f8c08955b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:35.975383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4583d2f-ea04-4a00-8fd9-c99f8c08955b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:36.027170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b4583d2f-ea04-4a00-8fd9-c99f8c08955b None None] MFA Rules not processed for user `bf5ff69a857f412fb65dce1b59a22e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:36.030164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b4583d2f-ea04-4a00-8fd9-c99f8c08955b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:36.068925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 843/1708] 10.222.0.61 () {58 vars in 1057 bytes} [Fri Jul 1 19:38:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:36.071338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d673fe-3dc0-440a-8b2e-ad99a3caa270 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:36.074292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e1d673fe-3dc0-440a-8b2e-ad99a3caa270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:36.118491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d673fe-3dc0-440a-8b2e-ad99a3caa270 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:36.139696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:36.141777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:36.142085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:36.148605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] PATH_INFO: `/v3/users/3189019801b54fbbb71e4e72419e93ad` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:36.151772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3189019801b54fbbb71e4e72419e93ad)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:36.173122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:36.221986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:36.243740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 866/1709] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:36.246124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c871-d5d7-4920-a7d8-f331b4612173 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:36.246553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c871-d5d7-4920-a7d8-f331b4612173 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:36.246760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539c871-d5d7-4920-a7d8-f331b4612173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:36.290359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c539c871-d5d7-4920-a7d8-f331b4612173 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:36.294683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c539c871-d5d7-4920-a7d8-f331b4612173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:36.312302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3189019801b54fbbb71e4e72419e93ad'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:36.313315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3189019801b54fbbb71e4e72419e93ad'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:36.324148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 867/1710] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:36.326781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c871-d5d7-4920-a7d8-f331b4612173 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:36.338286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3189019801b54fbbb71e4e72419e93ad'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:36.354241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539c871-d5d7-4920-a7d8-f331b4612173 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:36.360298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3189019801b54fbbb71e4e72419e93ad'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:36.369726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05052567-b478-4587-be70-950953a8e44b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:36.370437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05052567-b478-4587-be70-950953a8e44b service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:36.370720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05052567-b478-4587-be70-950953a8e44b service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:36.371007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05052567-b478-4587-be70-950953a8e44b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:36.375344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-05052567-b478-4587-be70-950953a8e44b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:36.388330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3189019801b54fbbb71e4e72419e93ad'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:36.400453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05052567-b478-4587-be70-950953a8e44b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:36.408638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05052567-b478-4587-be70-950953a8e44b service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:36.412009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 844/1711] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:36 2022] DELETE /identity/v3/users/3189019801b54fbbb71e4e72419e93ad => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:36.416949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:36.419144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:36.434944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 868/1712] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:36.442224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e384f-0d74-4af9-8dbd-7ec0ad11211b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:36.442517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e384f-0d74-4af9-8dbd-7ec0ad11211b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:36.442828 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e384f-0d74-4af9-8dbd-7ec0ad11211b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:36.477667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-aa1e384f-0d74-4af9-8dbd-7ec0ad11211b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:36.479196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-aa1e384f-0d74-4af9-8dbd-7ec0ad11211b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:36.580319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8b08d-1b6d-4065-8d2a-f200b304c56f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:36.593776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 869/1713] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:36.597636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:36.598587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:36.599058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:36.600878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:36.604087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:36.604629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:36.609416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:36.642010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 845/1714] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:36.643037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e384f-0d74-4af9-8dbd-7ec0ad11211b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:36.656249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e384f-0d74-4af9-8dbd-7ec0ad11211b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:36.682108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:36.683235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:36.683780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:36.684240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:36.685925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:36.692229 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:36.778073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 870/1715] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:36 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:38:36.782645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:36.799843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5233107-fe82-4811-ba50-4d7ef68c659b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:36.816596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:36.818740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:36.908108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:37.021083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ec3a6-b086-44be-bf24-1fefd1a3f0ae admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:37.034101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d6dce-6190-40cc-842f-0364a7a77d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:37.034349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f277274-1085-49c4-9693-3195480b6956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:37.034349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f277274-1085-49c4-9693-3195480b6956 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:37.034349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f277274-1085-49c4-9693-3195480b6956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:37.034349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f277274-1085-49c4-9693-3195480b6956 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:37.035111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6dce-6190-40cc-842f-0364a7a77d82 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:37.036175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6dce-6190-40cc-842f-0364a7a77d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:37.036960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d6dce-6190-40cc-842f-0364a7a77d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:37.040956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f277274-1085-49c4-9693-3195480b6956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:37.047652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f277274-1085-49c4-9693-3195480b6956 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:37.069264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d6dce-6190-40cc-842f-0364a7a77d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:37.071207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d6dce-6190-40cc-842f-0364a7a77d82 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:37.091413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 871/1716] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:37.112532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 846/1717] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:36 2022] POST /identity/v3/users => generated 286 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:37.113975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d6dce-6190-40cc-842f-0364a7a77d82 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:37.127453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d6dce-6190-40cc-842f-0364a7a77d82 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:37.138668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f05a12-a92e-4482-9e76-7b3ed45c6643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:37.139461 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05a12-a92e-4482-9e76-7b3ed45c6643 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:37.140468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05a12-a92e-4482-9e76-7b3ed45c6643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:37.140468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f05a12-a92e-4482-9e76-7b3ed45c6643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:37.143474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f05a12-a92e-4482-9e76-7b3ed45c6643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:37.147592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f05a12-a92e-4482-9e76-7b3ed45c6643 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:37.174446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 872/1718] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:37.179188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f277274-1085-49c4-9693-3195480b6956 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:37.194112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f277274-1085-49c4-9693-3195480b6956 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:37.210698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815626d0-b393-41e9-970a-b486afc73e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:37.211445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815626d0-b393-41e9-970a-b486afc73e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:37.214591 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815626d0-b393-41e9-970a-b486afc73e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:37.215073 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815626d0-b393-41e9-970a-b486afc73e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:37.216017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815626d0-b393-41e9-970a-b486afc73e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:37.219882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815626d0-b393-41e9-970a-b486afc73e53 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:37.233968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 847/1719] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:37.239021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f05a12-a92e-4482-9e76-7b3ed45c6643 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:37.263883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cb907-571f-41db-96da-352c89763e5e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:37.264343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cb907-571f-41db-96da-352c89763e5e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:37.264774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cb907-571f-41db-96da-352c89763e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:37.274987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f05a12-a92e-4482-9e76-7b3ed45c6643 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:37.285572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:37.297204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf9d20e-1fc3-427b-ae50-fed83d4049ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:37.298952 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-446cb907-571f-41db-96da-352c89763e5e None None] MFA Rules not processed for user `c4167eeb95ca4a95a7db1c8e2491a411`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:37.300162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d20e-1fc3-427b-ae50-fed83d4049ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:37.301210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d20e-1fc3-427b-ae50-fed83d4049ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:37.302966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf9d20e-1fc3-427b-ae50-fed83d4049ba admin admin] PATH_INFO: `/v3/projects/b15a998f497440a89c4300f55401d1eb/users/254f21b41fc34ee39ad5ed1c7a79dae6/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:37.303896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-446cb907-571f-41db-96da-352c89763e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:37.379398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9d20e-1fc3-427b-ae50-fed83d4049ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15a998f497440a89c4300f55401d1eb, user_id=254f21b41fc34ee39ad5ed1c7a79dae6, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:37.386794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf9d20e-1fc3-427b-ae50-fed83d4049ba admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:37.434249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 873/1720] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:37 2022] PUT /identity/v3/projects/b15a998f497440a89c4300f55401d1eb/users/254f21b41fc34ee39ad5ed1c7a79dae6/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:37.435969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf982a6-9c3e-4850-92ab-5e7de8e32334 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:37.436619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf982a6-9c3e-4850-92ab-5e7de8e32334 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:37.437210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf982a6-9c3e-4850-92ab-5e7de8e32334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:37.504186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 848/1721] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:37.517530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8cf982a6-9c3e-4850-92ab-5e7de8e32334 None None] MFA Rules not processed for user `254f21b41fc34ee39ad5ed1c7a79dae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:37.523054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8cf982a6-9c3e-4850-92ab-5e7de8e32334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:37.676809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 874/1722] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:37.717226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cb907-571f-41db-96da-352c89763e5e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:37.718721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-446cb907-571f-41db-96da-352c89763e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:37.767283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cb907-571f-41db-96da-352c89763e5e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:37.899346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:37.901154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:37.901691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:37.902156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] PATH_INFO: `/v3/users/543542a9fb6140aa8bd10b1a49e0488f` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:37.904130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=543542a9fb6140aa8bd10b1a49e0488f)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:37.906343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:37.999797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b755a-063e-403c-a19b-f985bc5d26e5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:38.000167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b755a-063e-403c-a19b-f985bc5d26e5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:38.000524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b755a-063e-403c-a19b-f985bc5d26e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:38.034862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543542a9fb6140aa8bd10b1a49e0488f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:38.035976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543542a9fb6140aa8bd10b1a49e0488f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:38.036682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-697b755a-063e-403c-a19b-f985bc5d26e5 None None] MFA Rules not processed for user `3229929e0f2f4c9fbb3dc6413b6db151`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:38.037919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-697b755a-063e-403c-a19b-f985bc5d26e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:38.054109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543542a9fb6140aa8bd10b1a49e0488f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:38.088527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543542a9fb6140aa8bd10b1a49e0488f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:38.116268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-422b1600-9e32-4e19-89e0-33ddbc6a0c0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543542a9fb6140aa8bd10b1a49e0488f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:38.126566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 849/1723] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:37 2022] DELETE /identity/v3/users/543542a9fb6140aa8bd10b1a49e0488f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:38.131634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09e9b3-16ed-4d9a-8125-32e2f87591fd None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:38.132507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09e9b3-16ed-4d9a-8125-32e2f87591fd None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:38.135782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09e9b3-16ed-4d9a-8125-32e2f87591fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:38.191113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bf09e9b3-16ed-4d9a-8125-32e2f87591fd None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:38.195641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bf09e9b3-16ed-4d9a-8125-32e2f87591fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:38.207671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 875/1724] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:38.249325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:38.354802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 850/1725] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:38.413034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b755a-063e-403c-a19b-f985bc5d26e5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:38.415466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-697b755a-063e-403c-a19b-f985bc5d26e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:38.427206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15567300-9427-4c2c-94c7-111194fe4b5b None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:38.427748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15567300-9427-4c2c-94c7-111194fe4b5b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:38.428294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15567300-9427-4c2c-94c7-111194fe4b5b None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:38.429901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 851/1726] 10.222.0.61 () {54 vars in 912 bytes} [Fri Jul 1 19:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 19:38:38.441281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321be63-f36d-4507-8140-14cd8a68d1fa None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:38.441503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321be63-f36d-4507-8140-14cd8a68d1fa None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:38.441795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321be63-f36d-4507-8140-14cd8a68d1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:38.489415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-2321be63-f36d-4507-8140-14cd8a68d1fa None None] MFA Rules not processed for user `9fcc425392664c17b72fb4655f8fb7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:38.491591 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2321be63-f36d-4507-8140-14cd8a68d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:38.506949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:38.563723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b755a-063e-403c-a19b-f985bc5d26e5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:38.669363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:38.670054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:38.670339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:38.670616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:38.672975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 852/1727] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:38:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:38.674148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321be63-f36d-4507-8140-14cd8a68d1fa None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:38.684367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:38.685738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:38.695144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2321be63-f36d-4507-8140-14cd8a68d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:38.736771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 876/1728] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:38.744174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:38.746351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:38.794653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc199d18-1885-4e3e-991d-f70373a2d27b service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:38.806806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:38.807798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:38.808183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:38.808560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:38.832307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:38.838668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:38.874646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321be63-f36d-4507-8140-14cd8a68d1fa None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:38.893982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddb7d6-3abc-4c02-a6da-c1ad4c9b05cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:38.895807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb7d6-3abc-4c02-a6da-c1ad4c9b05cb service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:38.896103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb7d6-3abc-4c02-a6da-c1ad4c9b05cb service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:38.896414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb7d6-3abc-4c02-a6da-c1ad4c9b05cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:38.902140 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-12ddb7d6-3abc-4c02-a6da-c1ad4c9b05cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:38.918958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 877/1729] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:39.013068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:39.015148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:39.059260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2492a-b715-4b47-b147-b3ead77c4c2a service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:39.080670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:39.081602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:39.081840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:39.082144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] PATH_INFO: `/v3/projects/525838fc50d64ee88b2cce6f75127a39` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:39.089918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddb7d6-3abc-4c02-a6da-c1ad4c9b05cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:39.091602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddb7d6-3abc-4c02-a6da-c1ad4c9b05cb service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:39.093577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525838fc50d64ee88b2cce6f75127a39)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:39.095553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:39.135459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 853/1730] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:39.167962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdf6ed-54c0-4988-8b78-b100b4005712 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:39.169575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdf6ed-54c0-4988-8b78-b100b4005712 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:39.171248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdf6ed-54c0-4988-8b78-b100b4005712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:39.321792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-9bcdf6ed-54c0-4988-8b78-b100b4005712 None None] MFA Rules not processed for user `0b4c1e464c194939ac4ead76af5440fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:39.324553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9bcdf6ed-54c0-4988-8b78-b100b4005712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:39.342556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:39.378137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525838fc50d64ee88b2cce6f75127a39', 'request_id': 'req-991e09bc-6478-405b-b954-9f4be0f96836'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:39.407026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525838fc50d64ee88b2cce6f75127a39', 'request_id': 'req-991e09bc-6478-405b-b954-9f4be0f96836'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:39.434069 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525838fc50d64ee88b2cce6f75127a39', 'request_id': 'req-991e09bc-6478-405b-b954-9f4be0f96836'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:39.486284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] The token cache is being invalidate because project 525838fc50d64ee88b2cce6f75127a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:39.486593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:39.491076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-991e09bc-6478-405b-b954-9f4be0f96836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:39.495274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 878/1731] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:39 2022] DELETE /identity/v3/projects/525838fc50d64ee88b2cce6f75127a39 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:38:39.502350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8921d-0fcf-4681-a02b-84987b5288a1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:39.502636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8921d-0fcf-4681-a02b-84987b5288a1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:39.509167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8921d-0fcf-4681-a02b-84987b5288a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:39.604642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-74c8921d-0fcf-4681-a02b-84987b5288a1 None None] MFA Rules not processed for user `b5040520134e464ea1d534767ea8728e`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:39.606071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-74c8921d-0fcf-4681-a02b-84987b5288a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:39.650783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 854/1732] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:39.651972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdf6ed-54c0-4988-8b78-b100b4005712 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:39.662976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9bcdf6ed-54c0-4988-8b78-b100b4005712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:39.825661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:39.869150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdf6ed-54c0-4988-8b78-b100b4005712 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:39.874775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:39.876055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:39.876540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:39.877805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] PATH_INFO: `/v3/users/9f73385d465e4fa5a68057c03a6986d1` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:39.880093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f73385d465e4fa5a68057c03a6986d1)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:39.887486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:39.908336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 879/1733] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:39.909850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8f4e-ca3a-43db-8711-d9dc979211f5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:39.910278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8f4e-ca3a-43db-8711-d9dc979211f5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:39.910619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f8f4e-ca3a-43db-8711-d9dc979211f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:39.971043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-cd0f8f4e-ca3a-43db-8711-d9dc979211f5 None None] MFA Rules not processed for user `0b4c1e464c194939ac4ead76af5440fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:39.972308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cd0f8f4e-ca3a-43db-8711-d9dc979211f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:40.007231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 880/1734] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:40.029848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f73385d465e4fa5a68057c03a6986d1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.036562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f73385d465e4fa5a68057c03a6986d1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.069641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f73385d465e4fa5a68057c03a6986d1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.100429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f73385d465e4fa5a68057c03a6986d1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.135217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-173a88e3-34ba-4e17-bbc2-1ab18142b5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f73385d465e4fa5a68057c03a6986d1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.158113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 855/1735] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:39 2022] DELETE /identity/v3/users/9f73385d465e4fa5a68057c03a6986d1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:40.203310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f8f4e-ca3a-43db-8711-d9dc979211f5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:40.204877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cd0f8f4e-ca3a-43db-8711-d9dc979211f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:40.264092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f8f4e-ca3a-43db-8711-d9dc979211f5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:40.422993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e04b4f-fdd8-4b65-af1c-4c4b67270e46 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:40.423435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e04b4f-fdd8-4b65-af1c-4c4b67270e46 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:40.423806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e04b4f-fdd8-4b65-af1c-4c4b67270e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:40.469618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d7e04b4f-fdd8-4b65-af1c-4c4b67270e46 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:40.473004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d7e04b4f-fdd8-4b65-af1c-4c4b67270e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:40.495653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:40.496605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:40.496889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:40.497171 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] PATH_INFO: `/v3/projects/dbc6f0cbc8d74da2ae293a955e5cdffb` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:40.502511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc6f0cbc8d74da2ae293a955e5cdffb)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:40.506679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:40.555326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:40.674095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc6f0cbc8d74da2ae293a955e5cdffb', 'request_id': 'req-43e5a171-d3ef-4a12-b854-946a1a336e54'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.690656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 856/1736] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:40.734679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc6f0cbc8d74da2ae293a955e5cdffb', 'request_id': 'req-43e5a171-d3ef-4a12-b854-946a1a336e54'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.739171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e04b4f-fdd8-4b65-af1c-4c4b67270e46 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:40.745445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d7e04b4f-fdd8-4b65-af1c-4c4b67270e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:40.750922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc6f0cbc8d74da2ae293a955e5cdffb', 'request_id': 'req-43e5a171-d3ef-4a12-b854-946a1a336e54'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.789125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] The token cache is being invalidate because project dbc6f0cbc8d74da2ae293a955e5cdffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:40.792157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.793324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:40.799926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 881/1737] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:40 2022] DELETE /identity/v3/projects/dbc6f0cbc8d74da2ae293a955e5cdffb => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:40.804602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:40.809247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:40.995629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5a171-d3ef-4a12-b854-946a1a336e54 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:41.002816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:41.003018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e04b4f-fdd8-4b65-af1c-4c4b67270e46 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:41.003935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:41.004297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:41.019961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] PATH_INFO: `/v3/users/d42c0a7e9f8247f184e5407f95e44400` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:41.022581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42c0a7e9f8247f184e5407f95e44400)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:41.027646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:41.041164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:41.142802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42c0a7e9f8247f184e5407f95e44400'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:41.173677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42c0a7e9f8247f184e5407f95e44400'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:41.175343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42c0a7e9f8247f184e5407f95e44400'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:41.193708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42c0a7e9f8247f184e5407f95e44400'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:41.209407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:41.212628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:41.213292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:41.213634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:41.219497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:41.226722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42c0a7e9f8247f184e5407f95e44400'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:41.269806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 882/1738] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:40 2022] DELETE /identity/v3/users/d42c0a7e9f8247f184e5407f95e44400 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:41.272141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:41.279211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:41.433893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:41.441056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:41.470276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 857/1739] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:41.534909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baefd789-178e-414e-a116-ec194ccadc3d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:41.548886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:41.550154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:41.551728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:41.552763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:41.559400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:41.616083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:41.618509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:41.644310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b4e2-244f-4f31-ad8b-fba7fac0aa8d service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:41.653426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:41.692313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:41.694079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:41.706218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 883/1740] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:38:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:38:41.709419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:41.711676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:41.773553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:41.899534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d96a3-0d71-4fce-ac7c-151384f52f9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:41.901432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d96a3-0d71-4fce-ac7c-151384f52f9c service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:41.901726 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d96a3-0d71-4fce-ac7c-151384f52f9c service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:41.904389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d96a3-0d71-4fce-ac7c-151384f52f9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:41.909437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-eb9d96a3-0d71-4fce-ac7c-151384f52f9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:42.016580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03e9f1-6b84-4586-bf5e-31a7cd55656a service swift] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:42.054554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:42.064802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:42.065099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:42.065380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] PATH_INFO: `/v3/projects/7fb248fa67784f1ca066331420c50edb` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:42.069611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb248fa67784f1ca066331420c50edb)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:42.076165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:42.169332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d96a3-0d71-4fce-ac7c-151384f52f9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:42.177321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d96a3-0d71-4fce-ac7c-151384f52f9c service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:42.200550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 858/1741] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:42.301109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb248fa67784f1ca066331420c50edb', 'request_id': 'req-bdc1aea8-6406-4765-8bc3-cec5547aea6e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:42.340696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb248fa67784f1ca066331420c50edb', 'request_id': 'req-bdc1aea8-6406-4765-8bc3-cec5547aea6e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:42.364316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb248fa67784f1ca066331420c50edb', 'request_id': 'req-bdc1aea8-6406-4765-8bc3-cec5547aea6e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:42.403527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] The token cache is being invalidate because project 7fb248fa67784f1ca066331420c50edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:42.403527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:42.403527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-bdc1aea8-6406-4765-8bc3-cec5547aea6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:42.406321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 884/1742] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:41 2022] DELETE /identity/v3/projects/7fb248fa67784f1ca066331420c50edb => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:42.411055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c1f9-7b76-4929-8d62-71a9f9d682d7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:42.411575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c1f9-7b76-4929-8d62-71a9f9d682d7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:42.411655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c1f9-7b76-4929-8d62-71a9f9d682d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:42.514441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-08b6c1f9-7b76-4929-8d62-71a9f9d682d7 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:42.519924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-08b6c1f9-7b76-4929-8d62-71a9f9d682d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:42.828039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 859/1743] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:42.836869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc9541-b528-4365-9f10-1105886f181d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:42.837936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc9541-b528-4365-9f10-1105886f181d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:42.838396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc9541-b528-4365-9f10-1105886f181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:42.897884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-96fc9541-b528-4365-9f10-1105886f181d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:42.899227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-96fc9541-b528-4365-9f10-1105886f181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:42.957464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 885/1744] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:42.963427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6c1f9-7b76-4929-8d62-71a9f9d682d7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:42.977532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6c1f9-7b76-4929-8d62-71a9f9d682d7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:43.023084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:43.023270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:43.023648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:43.023965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:43.024850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:43.054336 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:43.056311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:43.121658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 860/1745] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:43.123317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc9541-b528-4365-9f10-1105886f181d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:43.154779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc9541-b528-4365-9f10-1105886f181d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:43.161101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7715ca1-7391-49e6-b40c-0dfee7b1f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:43.161733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7715ca1-7391-49e6-b40c-0dfee7b1f18f admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:43.162076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7715ca1-7391-49e6-b40c-0dfee7b1f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:43.162373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7715ca1-7391-49e6-b40c-0dfee7b1f18f admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:43.163119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7715ca1-7391-49e6-b40c-0dfee7b1f18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:43.165415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7715ca1-7391-49e6-b40c-0dfee7b1f18f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:43.258758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 886/1746] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:43 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:43.264031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:43.307449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea82d5e-4029-47cf-9778-d8eb8490edbc admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:43.396417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:43.474435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94761af-64c7-47c2-adfe-f8c85b769be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:43.475293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94761af-64c7-47c2-adfe-f8c85b769be8 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:43.475587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94761af-64c7-47c2-adfe-f8c85b769be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:43.476008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94761af-64c7-47c2-adfe-f8c85b769be8 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:43.476711 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94761af-64c7-47c2-adfe-f8c85b769be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:43.478949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94761af-64c7-47c2-adfe-f8c85b769be8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:43.544937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 861/1747] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:43 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:43.548912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7715ca1-7391-49e6-b40c-0dfee7b1f18f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:43.566698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7715ca1-7391-49e6-b40c-0dfee7b1f18f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:43.582447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166029c-215a-460c-901e-589beb34fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:43.583063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166029c-215a-460c-901e-589beb34fb3d admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:43.584526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166029c-215a-460c-901e-589beb34fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:43.584526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166029c-215a-460c-901e-589beb34fb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:43.584526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166029c-215a-460c-901e-589beb34fb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:43.586082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166029c-215a-460c-901e-589beb34fb3d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:43.610083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 887/1748] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:43.613832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94761af-64c7-47c2-adfe-f8c85b769be8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:43.627589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94761af-64c7-47c2-adfe-f8c85b769be8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:43.641878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86d0f7-65d3-4576-a910-b7d3fce299d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:43.642659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d0f7-65d3-4576-a910-b7d3fce299d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:43.643678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d0f7-65d3-4576-a910-b7d3fce299d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:43.643974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86d0f7-65d3-4576-a910-b7d3fce299d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:43.644779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d0f7-65d3-4576-a910-b7d3fce299d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:43.650530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86d0f7-65d3-4576-a910-b7d3fce299d0 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:43.687909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 862/1749] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:43.691689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166029c-215a-460c-901e-589beb34fb3d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:43.707466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166029c-215a-460c-901e-589beb34fb3d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:43.730039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88bb89-83be-45cc-882e-21a87a169745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:43.730966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bb89-83be-45cc-882e-21a87a169745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:43.731248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bb89-83be-45cc-882e-21a87a169745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:43.731526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88bb89-83be-45cc-882e-21a87a169745 admin admin] PATH_INFO: `/v3/projects/a02cd387f70a4e1283d28fbdf30cca79/users/b3f3aa329459432fb57278613c13572f/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:43.766678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88bb89-83be-45cc-882e-21a87a169745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02cd387f70a4e1283d28fbdf30cca79, user_id=b3f3aa329459432fb57278613c13572f, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:43.769550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88bb89-83be-45cc-882e-21a87a169745 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:43.792835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 888/1750] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:43 2022] PUT /identity/v3/projects/a02cd387f70a4e1283d28fbdf30cca79/users/b3f3aa329459432fb57278613c13572f/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:43.803273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df193-ed21-4361-883a-1aa9e59db325 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:43.803628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df193-ed21-4361-883a-1aa9e59db325 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:43.803912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81df193-ed21-4361-883a-1aa9e59db325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:43.913932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f81df193-ed21-4361-883a-1aa9e59db325 None None] MFA Rules not processed for user `b3f3aa329459432fb57278613c13572f`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:43.919217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f81df193-ed21-4361-883a-1aa9e59db325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:44.170972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 863/1751] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:44.175305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88bb89-83be-45cc-882e-21a87a169745 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:44.254975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:44.276753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88bb89-83be-45cc-882e-21a87a169745 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:44.283007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:44.283670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:44.284154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:44.284449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:44.285192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:44.287664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:44.338176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 889/1752] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:44 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:44.342863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81df193-ed21-4361-883a-1aa9e59db325 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:44.377667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81df193-ed21-4361-883a-1aa9e59db325 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:44.480863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:44.495302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:44.569466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263725-d1fd-4142-97a7-6e0665ab2551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:44.572824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263725-d1fd-4142-97a7-6e0665ab2551 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:44.574155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263725-d1fd-4142-97a7-6e0665ab2551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:44.575389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7263725-d1fd-4142-97a7-6e0665ab2551 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:44.577055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7263725-d1fd-4142-97a7-6e0665ab2551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:44.580120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7263725-d1fd-4142-97a7-6e0665ab2551 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:44.631734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 864/1753] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:44 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:44.636553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263725-d1fd-4142-97a7-6e0665ab2551 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:44.670322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7263725-d1fd-4142-97a7-6e0665ab2551 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:44.684558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8cb5-a680-4b7c-af07-4174d867c32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:44.687818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8cb5-a680-4b7c-af07-4174d867c32a admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:44.689149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8cb5-a680-4b7c-af07-4174d867c32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:44.689904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c8cb5-a680-4b7c-af07-4174d867c32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:44.692704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c8cb5-a680-4b7c-af07-4174d867c32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:44.700683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c8cb5-a680-4b7c-af07-4174d867c32a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:44.735183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 865/1754] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:44.736090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c06f2-69b7-475f-8db8-9d54556be2f0 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:44.745086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8cb5-a680-4b7c-af07-4174d867c32a admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:44.756824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:44.757058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c8cb5-a680-4b7c-af07-4174d867c32a admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:44.757933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:44.758234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:44.761396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] PATH_INFO: `/v3/projects/e0aaa3ba67394b9bbb37312b6294885c` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:44.762836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0aaa3ba67394b9bbb37312b6294885c)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:44.771332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca752e4-2621-4b22-afe8-c5584ebc02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:44.773167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca752e4-2621-4b22-afe8-c5584ebc02cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:44.773667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca752e4-2621-4b22-afe8-c5584ebc02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:44.774170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca752e4-2621-4b22-afe8-c5584ebc02cf admin admin] PATH_INFO: `/v3/projects/35d3763a8a1d4a8bb17a9d5add45f6ea/users/07171037dc4b49438a3b543fe1fd4021/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:44.778232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:44.799487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca752e4-2621-4b22-afe8-c5584ebc02cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d3763a8a1d4a8bb17a9d5add45f6ea, user_id=07171037dc4b49438a3b543fe1fd4021, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:44.802411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca752e4-2621-4b22-afe8-c5584ebc02cf admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:44.805278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:44.842788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 866/1755] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:44 2022] PUT /identity/v3/projects/35d3763a8a1d4a8bb17a9d5add45f6ea/users/07171037dc4b49438a3b543fe1fd4021/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:38:44.843841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca752e4-2621-4b22-afe8-c5584ebc02cf admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:44.915440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0aaa3ba67394b9bbb37312b6294885c', 'request_id': 'req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:44.932417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0aaa3ba67394b9bbb37312b6294885c', 'request_id': 'req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:44.945892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0aaa3ba67394b9bbb37312b6294885c', 'request_id': 'req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:44.975331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] The token cache is being invalidate because project e0aaa3ba67394b9bbb37312b6294885c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:44.975758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:44.977359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2ada417d-0007-432c-b8a8-00e3bd8b6dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:44.981697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 890/1756] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:44 2022] DELETE /identity/v3/projects/e0aaa3ba67394b9bbb37312b6294885c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:44.994557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ea86-0be0-4831-a9ca-4ff28396cf63 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:44.994885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ea86-0be0-4831-a9ca-4ff28396cf63 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:44.995209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836ea86-0be0-4831-a9ca-4ff28396cf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:45.043660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca752e4-2621-4b22-afe8-c5584ebc02cf admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:45.047813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c836ea86-0be0-4831-a9ca-4ff28396cf63 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:45.047813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c836ea86-0be0-4831-a9ca-4ff28396cf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:45.219884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 891/1757] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:45.222974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3213-762c-4b19-92e3-46106ab91feb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:45.225257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3213-762c-4b19-92e3-46106ab91feb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:45.225690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb3213-762c-4b19-92e3-46106ab91feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:45.273998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-60eb3213-762c-4b19-92e3-46106ab91feb None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:45.276934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-60eb3213-762c-4b19-92e3-46106ab91feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:45.298090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:45.299759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:45.300196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:45.300692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:45.301596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:45.304161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:45.311293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 892/1758] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:45.320877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb3213-762c-4b19-92e3-46106ab91feb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:45.332575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:45.349885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb3213-762c-4b19-92e3-46106ab91feb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:45.356378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 867/1759] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:45.358515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:45.365040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:45.376740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:45.377769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:45.379678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:45.380136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:45.381100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:45.387640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:45.387640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:45.407107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f1ae8-a6ae-4ee8-803e-d5da5ad3dbe9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:45.429183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 893/1760] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:45.436490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76165b-1b6c-4428-a1d5-596187374058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:45.437656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76165b-1b6c-4428-a1d5-596187374058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:45.438289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76165b-1b6c-4428-a1d5-596187374058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:45.439003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76165b-1b6c-4428-a1d5-596187374058 admin admin] PATH_INFO: `/v3/projects/35d3763a8a1d4a8bb17a9d5add45f6ea/users/07171037dc4b49438a3b543fe1fd4021/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:45.443597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76165b-1b6c-4428-a1d5-596187374058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d3763a8a1d4a8bb17a9d5add45f6ea, user_id=07171037dc4b49438a3b543fe1fd4021, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:45.445559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:45.450567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76165b-1b6c-4428-a1d5-596187374058 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:45.464761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 868/1761] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:45 2022] PUT /identity/v3/projects/35d3763a8a1d4a8bb17a9d5add45f6ea/users/07171037dc4b49438a3b543fe1fd4021/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:45.475510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269137c0-ca53-43ff-a01b-f9c525664d5b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:45.475987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269137c0-ca53-43ff-a01b-f9c525664d5b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:45.476275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269137c0-ca53-43ff-a01b-f9c525664d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:45.485036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3975c26-da57-4a4d-8e81-0ab6a7f77356 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:45.521512 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-269137c0-ca53-43ff-a01b-f9c525664d5b None None] MFA Rules not processed for user `07171037dc4b49438a3b543fe1fd4021`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:45.524391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-269137c0-ca53-43ff-a01b-f9c525664d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:45.711770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf1954-0836-4a3a-b777-281e57ed0191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:45.712703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1954-0836-4a3a-b777-281e57ed0191 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:45.713904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1954-0836-4a3a-b777-281e57ed0191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:45.714799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf1954-0836-4a3a-b777-281e57ed0191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:45.716419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf1954-0836-4a3a-b777-281e57ed0191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:45.723751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf1954-0836-4a3a-b777-281e57ed0191 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:45.766714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 869/1762] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:45.777218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269137c0-ca53-43ff-a01b-f9c525664d5b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:45.782351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-269137c0-ca53-43ff-a01b-f9c525664d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:45.802418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 894/1763] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:45 2022] POST /identity/v3/projects => generated 377 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:45.803780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf1954-0836-4a3a-b777-281e57ed0191 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:45.819296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:45.944025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269137c0-ca53-43ff-a01b-f9c525664d5b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:46.042269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf1954-0836-4a3a-b777-281e57ed0191 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:46.068826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04754-728c-4a5b-9f17-6b0dcdc88dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:46.070068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04754-728c-4a5b-9f17-6b0dcdc88dda admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:46.070551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04754-728c-4a5b-9f17-6b0dcdc88dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:46.070913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd04754-728c-4a5b-9f17-6b0dcdc88dda admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:46.072125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04754-728c-4a5b-9f17-6b0dcdc88dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:46.079571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd04754-728c-4a5b-9f17-6b0dcdc88dda admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:46.130433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:46.131148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:46.131445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:46.131788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:46.136838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:46.154304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 895/1764] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:45 2022] POST /identity/v3/users => generated 289 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:46.156775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04754-728c-4a5b-9f17-6b0dcdc88dda admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:46.183419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd04754-728c-4a5b-9f17-6b0dcdc88dda admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:46.194719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4990db4-3c89-4eb4-be4b-c0992f24d49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:46.195936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4990db4-3c89-4eb4-be4b-c0992f24d49d admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:46.197796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4990db4-3c89-4eb4-be4b-c0992f24d49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:46.197796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4990db4-3c89-4eb4-be4b-c0992f24d49d admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:46.197796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4990db4-3c89-4eb4-be4b-c0992f24d49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:46.205905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4990db4-3c89-4eb4-be4b-c0992f24d49d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:46.233311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 896/1765] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:46.237048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4990db4-3c89-4eb4-be4b-c0992f24d49d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:46.261335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4990db4-3c89-4eb4-be4b-c0992f24d49d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:46.276476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:46.278009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:46.296339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb013b74-1680-4513-bf08-e5f7ad01a9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:46.296964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013b74-1680-4513-bf08-e5f7ad01a9dc admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:46.297252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013b74-1680-4513-bf08-e5f7ad01a9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:46.297537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb013b74-1680-4513-bf08-e5f7ad01a9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:46.298313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb013b74-1680-4513-bf08-e5f7ad01a9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:46.299941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb013b74-1680-4513-bf08-e5f7ad01a9dc admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:46.307704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 870/1766] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:46.352074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 897/1767] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:46.353166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:46.375526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c245e0-bfc1-4c23-aa7a-b5cb68016490 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:46.391858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ee37f-0278-47b5-82be-432590516750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:46.392801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ee37f-0278-47b5-82be-432590516750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:46.393089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ee37f-0278-47b5-82be-432590516750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:46.393370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ee37f-0278-47b5-82be-432590516750 admin admin] PATH_INFO: `/v3/projects/ddabecff4cf0462e8e486ce678f727e5/users/0830440d479a4579aa2807e51805919b/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:46.438920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ee37f-0278-47b5-82be-432590516750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddabecff4cf0462e8e486ce678f727e5, user_id=0830440d479a4579aa2807e51805919b, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:46.449569 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ee37f-0278-47b5-82be-432590516750 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:46.485442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 871/1768] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:46 2022] PUT /identity/v3/projects/ddabecff4cf0462e8e486ce678f727e5/users/0830440d479a4579aa2807e51805919b/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:38:46.496700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63890e5-f6bc-4e7c-82b1-80dac36ca6a2 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:46.498572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63890e5-f6bc-4e7c-82b1-80dac36ca6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:46.499611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63890e5-f6bc-4e7c-82b1-80dac36ca6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:46.610462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d63890e5-f6bc-4e7c-82b1-80dac36ca6a2 None None] MFA Rules not processed for user `0830440d479a4579aa2807e51805919b`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:46.614102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d63890e5-f6bc-4e7c-82b1-80dac36ca6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:46.841966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:47.101822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ee37f-0278-47b5-82be-432590516750 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:47.103164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 898/1769] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 607 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:47.418763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:47.443626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ee37f-0278-47b5-82be-432590516750 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:47.452053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e562092-46f4-4df8-b508-4613baed8d4f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:47.452654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e562092-46f4-4df8-b508-4613baed8d4f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:47.452654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e562092-46f4-4df8-b508-4613baed8d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:47.469664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1376d-b61a-4975-969e-32daa1965cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:47.475789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1376d-b61a-4975-969e-32daa1965cce admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:47.478996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1376d-b61a-4975-969e-32daa1965cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:47.481199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1376d-b61a-4975-969e-32daa1965cce admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:47.482832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1376d-b61a-4975-969e-32daa1965cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:47.501217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d1376d-b61a-4975-969e-32daa1965cce admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:47.523847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2e562092-46f4-4df8-b508-4613baed8d4f None None] MFA Rules not processed for user `9fcc425392664c17b72fb4655f8fb7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:47.535505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2e562092-46f4-4df8-b508-4613baed8d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:47.597480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 872/1770] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:47 2022] POST /identity/v3/projects => generated 373 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:47.610940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1376d-b61a-4975-969e-32daa1965cce admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:47.736277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1376d-b61a-4975-969e-32daa1965cce admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:47.743674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e185-744a-443f-960e-1be9e6b76a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:47.745057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e185-744a-443f-960e-1be9e6b76a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:47.745986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e185-744a-443f-960e-1be9e6b76a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:47.746579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98e185-744a-443f-960e-1be9e6b76a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:47.747802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98e185-744a-443f-960e-1be9e6b76a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:47.750855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98e185-744a-443f-960e-1be9e6b76a19 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:47.836109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 873/1771] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:47 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:47.840047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e185-744a-443f-960e-1be9e6b76a19 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:47.842657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 899/1772] 10.222.0.57 () {58 vars in 1015 bytes} [Fri Jul 1 19:38:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:47.897659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98e185-744a-443f-960e-1be9e6b76a19 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:47.905594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503ea5-04e0-4bfc-8b07-f477325d9984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:47.910470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503ea5-04e0-4bfc-8b07-f477325d9984 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:47.912488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503ea5-04e0-4bfc-8b07-f477325d9984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:47.916545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e503ea5-04e0-4bfc-8b07-f477325d9984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:47.919769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e503ea5-04e0-4bfc-8b07-f477325d9984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:47.928136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e503ea5-04e0-4bfc-8b07-f477325d9984 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:47.975506 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e562092-46f4-4df8-b508-4613baed8d4f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:47.980728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2e562092-46f4-4df8-b508-4613baed8d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:48.005868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 874/1773] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:48.008133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503ea5-04e0-4bfc-8b07-f477325d9984 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:48.038522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e562092-46f4-4df8-b508-4613baed8d4f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:48.076854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e503ea5-04e0-4bfc-8b07-f477325d9984 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:48.096439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc1bcc-fc62-44ef-b85a-9806477de6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:48.107085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc1bcc-fc62-44ef-b85a-9806477de6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:48.107697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc1bcc-fc62-44ef-b85a-9806477de6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:48.107697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc1bcc-fc62-44ef-b85a-9806477de6fc admin admin] PATH_INFO: `/v3/projects/57014c747c2442a28d3f3fecafe68a01/users/78f34cd5f6d446eb87508162c026a85b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:48.170390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d037c-3042-49f3-bff7-fb78d90a0547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:48.173257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d037c-3042-49f3-bff7-fb78d90a0547 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:48.174600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d037c-3042-49f3-bff7-fb78d90a0547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:48.174926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d037c-3042-49f3-bff7-fb78d90a0547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:48.188866 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc1bcc-fc62-44ef-b85a-9806477de6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=57014c747c2442a28d3f3fecafe68a01, user_id=78f34cd5f6d446eb87508162c026a85b, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:48.197330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d037c-3042-49f3-bff7-fb78d90a0547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:48.199072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d037c-3042-49f3-bff7-fb78d90a0547 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:48.206467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc1bcc-fc62-44ef-b85a-9806477de6fc admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:48.235646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 900/1774] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:38:48.263280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 875/1775] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:48 2022] PUT /identity/v3/projects/57014c747c2442a28d3f3fecafe68a01/users/78f34cd5f6d446eb87508162c026a85b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:48.267471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d037c-3042-49f3-bff7-fb78d90a0547 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:48.292129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d037c-3042-49f3-bff7-fb78d90a0547 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:48.483958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768de93-3780-4fe5-baac-345e37d70602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:48.487706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768de93-3780-4fe5-baac-345e37d70602 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:48.488834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768de93-3780-4fe5-baac-345e37d70602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:48.489349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768de93-3780-4fe5-baac-345e37d70602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:48.492261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768de93-3780-4fe5-baac-345e37d70602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:48.499397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768de93-3780-4fe5-baac-345e37d70602 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:48.532873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 901/1776] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:48.544843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc1bcc-fc62-44ef-b85a-9806477de6fc admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:48.615156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc1bcc-fc62-44ef-b85a-9806477de6fc admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:48.659094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:48.660258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:48.660381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:48.660818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] PATH_INFO: `/v3/projects/57014c747c2442a28d3f3fecafe68a01/users/78f34cd5f6d446eb87508162c026a85b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:48.664332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57014c747c2442a28d3f3fecafe68a01, user_id=78f34cd5f6d446eb87508162c026a85b, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:48.668918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:48.757212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 876/1777] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:48 2022] PUT /identity/v3/projects/57014c747c2442a28d3f3fecafe68a01/users/78f34cd5f6d446eb87508162c026a85b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:48.759272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095f6b-6bdf-4731-9818-a9c8794087a1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:48.760135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095f6b-6bdf-4731-9818-a9c8794087a1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:48.760524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095f6b-6bdf-4731-9818-a9c8794087a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:48.823190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-da095f6b-6bdf-4731-9818-a9c8794087a1 None None] MFA Rules not processed for user `78f34cd5f6d446eb87508162c026a85b`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:48.824446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-da095f6b-6bdf-4731-9818-a9c8794087a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:48.850594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:49.017726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 902/1778] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:49.033408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:49.035564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:49.215642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c351b-dac4-4eb7-a225-b10d4d2d6a54 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:49.226906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f58260-a6aa-4a73-adf1-569084660dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:49.228877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f58260-a6aa-4a73-adf1-569084660dcb service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:49.229566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f58260-a6aa-4a73-adf1-569084660dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:49.229697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f58260-a6aa-4a73-adf1-569084660dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:49.352365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:49.402955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f58260-a6aa-4a73-adf1-569084660dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:49.404608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f58260-a6aa-4a73-adf1-569084660dcb service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:49.421975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 877/1779] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:51.149300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da095f6b-6bdf-4731-9818-a9c8794087a1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:51.151851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-da095f6b-6bdf-4731-9818-a9c8794087a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:51.379956 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da095f6b-6bdf-4731-9818-a9c8794087a1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:51.385581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:51.397989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:51.398789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:51.399399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] PATH_INFO: `/v3/users/254f21b41fc34ee39ad5ed1c7a79dae6` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:51.403799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254f21b41fc34ee39ad5ed1c7a79dae6)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:51.408778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:51.524843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254f21b41fc34ee39ad5ed1c7a79dae6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:51.536673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254f21b41fc34ee39ad5ed1c7a79dae6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:51.538543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254f21b41fc34ee39ad5ed1c7a79dae6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:51.560367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254f21b41fc34ee39ad5ed1c7a79dae6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:51.594090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254f21b41fc34ee39ad5ed1c7a79dae6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:51.609582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 903/1780] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:51 2022] DELETE /identity/v3/users/254f21b41fc34ee39ad5ed1c7a79dae6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:51.613902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c693a23-0886-4db3-a763-092e53c92cc7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:51.614462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c693a23-0886-4db3-a763-092e53c92cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:51.614462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c693a23-0886-4db3-a763-092e53c92cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:51.653161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3c693a23-0886-4db3-a763-092e53c92cc7 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:51.654449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3c693a23-0886-4db3-a763-092e53c92cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:51.831005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 878/1781] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:51.979476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:51.981167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:52.107736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:52.191872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4a556-7bd8-432a-8b4e-ee1be323aea9 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:52.210054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391f4a0-f8ec-4911-a492-579494ce9179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:52.211787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391f4a0-f8ec-4911-a492-579494ce9179 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:52.212107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391f4a0-f8ec-4911-a492-579494ce9179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:52.212574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391f4a0-f8ec-4911-a492-579494ce9179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:52.263001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391f4a0-f8ec-4911-a492-579494ce9179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:52.270327 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391f4a0-f8ec-4911-a492-579494ce9179 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:52.307695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 904/1782] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:53.205676 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a6d8c-2c97-4719-a2d1-51bf887582b7 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:53.206294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a6d8c-2c97-4719-a2d1-51bf887582b7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:53.206294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a6d8c-2c97-4719-a2d1-51bf887582b7 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:53.208105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 879/1783] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:38:53.233839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74538e6-0d56-409e-bdcc-958adebf1487 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:53.234487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74538e6-0d56-409e-bdcc-958adebf1487 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:53.234581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74538e6-0d56-409e-bdcc-958adebf1487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:53.332047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f74538e6-0d56-409e-bdcc-958adebf1487 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:53.333505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f74538e6-0d56-409e-bdcc-958adebf1487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:53.548365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 905/1784] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:38:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:53.595425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a6d8c-2c97-4719-a2d1-51bf887582b7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:53.597814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-720a6d8c-2c97-4719-a2d1-51bf887582b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:53.635721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a6d8c-2c97-4719-a2d1-51bf887582b7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:53.644176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3196-6d4c-42f4-8df1-2ecac3af07a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:53.645181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3196-6d4c-42f4-8df1-2ecac3af07a4 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:53.645719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3196-6d4c-42f4-8df1-2ecac3af07a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:53.646287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3196-6d4c-42f4-8df1-2ecac3af07a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:53.661642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3196-6d4c-42f4-8df1-2ecac3af07a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:53.664320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3196-6d4c-42f4-8df1-2ecac3af07a4 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:53.679034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 880/1785] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:54.281510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74538e6-0d56-409e-bdcc-958adebf1487 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:54.283190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f74538e6-0d56-409e-bdcc-958adebf1487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:54.305607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74538e6-0d56-409e-bdcc-958adebf1487 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:54.315212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:54.318364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:54.318653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:54.318934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] PATH_INFO: `/v3/projects/b15a998f497440a89c4300f55401d1eb` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:54.323463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15a998f497440a89c4300f55401d1eb)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:54.328152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:54.423817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15a998f497440a89c4300f55401d1eb', 'request_id': 'req-d2377b2a-72ec-486a-905b-976df4a7f2c2'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:54.443738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda73bc-a705-403b-9d89-9258348f09e9 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:54.444635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda73bc-a705-403b-9d89-9258348f09e9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:54.445176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda73bc-a705-403b-9d89-9258348f09e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:54.447873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15a998f497440a89c4300f55401d1eb', 'request_id': 'req-d2377b2a-72ec-486a-905b-976df4a7f2c2'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:54.456261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15a998f497440a89c4300f55401d1eb', 'request_id': 'req-d2377b2a-72ec-486a-905b-976df4a7f2c2'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:54.466083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0cda73bc-a705-403b-9d89-9258348f09e9 None None] MFA Rules not processed for user `b5040520134e464ea1d534767ea8728e`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:54.467536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0cda73bc-a705-403b-9d89-9258348f09e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:54.473345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] The token cache is being invalidate because project b15a998f497440a89c4300f55401d1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:54.473570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:54.474165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d2377b2a-72ec-486a-905b-976df4a7f2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:54.476110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 906/1786] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:54 2022] DELETE /identity/v3/projects/b15a998f497440a89c4300f55401d1eb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:38:54.481444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf999d6-31f7-4447-8de8-978309b069eb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:54.481833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf999d6-31f7-4447-8de8-978309b069eb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:54.482971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf999d6-31f7-4447-8de8-978309b069eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:54.511545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-fbf999d6-31f7-4447-8de8-978309b069eb None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:54.512128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fbf999d6-31f7-4447-8de8-978309b069eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:54.546196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 881/1787] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:54.578169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:54.611143 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 907/1788] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:54.613540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8f74-0297-4b93-bd06-f8d6ab2b6e1d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:54.613830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8f74-0297-4b93-bd06-f8d6ab2b6e1d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:54.614138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b8f74-0297-4b93-bd06-f8d6ab2b6e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:54.633395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-128b8f74-0297-4b93-bd06-f8d6ab2b6e1d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:54.635047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-128b8f74-0297-4b93-bd06-f8d6ab2b6e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:54.644131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 882/1789] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:54.648894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf999d6-31f7-4447-8de8-978309b069eb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:54.658895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf999d6-31f7-4447-8de8-978309b069eb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:54.665185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:54.667234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:54.667234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:54.667863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:54.668556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:54.668871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:54.670536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:54.688681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 908/1790] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:54.692585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b8f74-0297-4b93-bd06-f8d6ab2b6e1d None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:54.705541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b8f74-0297-4b93-bd06-f8d6ab2b6e1d None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:54.721048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ce3a-c437-42bb-8585-ed3fae5a11c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:54.722554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ce3a-c437-42bb-8585-ed3fae5a11c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:54.722909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ce3a-c437-42bb-8585-ed3fae5a11c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:54.723198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98ce3a-c437-42bb-8585-ed3fae5a11c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:54.723971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98ce3a-c437-42bb-8585-ed3fae5a11c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:54.726358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98ce3a-c437-42bb-8585-ed3fae5a11c2 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:54.784534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:54.803589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 883/1791] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:54 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:54.814615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e93dd-0767-49db-a00e-1271f42b110e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:54.894109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1d76-49e8-42fd-a30c-ba0f06b58fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:54.894562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1d76-49e8-42fd-a30c-ba0f06b58fae admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:54.894991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1d76-49e8-42fd-a30c-ba0f06b58fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:54.895335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb1d76-49e8-42fd-a30c-ba0f06b58fae admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:54.896297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb1d76-49e8-42fd-a30c-ba0f06b58fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:54.898558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb1d76-49e8-42fd-a30c-ba0f06b58fae admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:54.923296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 909/1792] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:54 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:54.929933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ce3a-c437-42bb-8585-ed3fae5a11c2 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:54.942288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98ce3a-c437-42bb-8585-ed3fae5a11c2 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:54.969394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03904fc-fb4c-41d7-9ad4-c2acc88d0284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:54.970302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03904fc-fb4c-41d7-9ad4-c2acc88d0284 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:54.970658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03904fc-fb4c-41d7-9ad4-c2acc88d0284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:54.971188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03904fc-fb4c-41d7-9ad4-c2acc88d0284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:54.972067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03904fc-fb4c-41d7-9ad4-c2acc88d0284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:54.973898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03904fc-fb4c-41d7-9ad4-c2acc88d0284 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:54.990304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 884/1793] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:54.993655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1d76-49e8-42fd-a30c-ba0f06b58fae admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:55.009721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb1d76-49e8-42fd-a30c-ba0f06b58fae admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:55.025710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67430e-b380-4d42-87f2-196a76e76cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:55.026918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67430e-b380-4d42-87f2-196a76e76cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.027021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67430e-b380-4d42-87f2-196a76e76cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.027644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67430e-b380-4d42-87f2-196a76e76cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.028495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67430e-b380-4d42-87f2-196a76e76cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:55.031516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67430e-b380-4d42-87f2-196a76e76cfd admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:55.066784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 910/1794] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:55.069604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03904fc-fb4c-41d7-9ad4-c2acc88d0284 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:55.081896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03904fc-fb4c-41d7-9ad4-c2acc88d0284 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:55.102496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698a41b-4f9a-47b2-8975-32687df4dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:55.103456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a41b-4f9a-47b2-8975-32687df4dc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.103683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a41b-4f9a-47b2-8975-32687df4dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.103959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a41b-4f9a-47b2-8975-32687df4dc23 admin admin] PATH_INFO: `/v3/projects/e81bd41a7595412682d22a7a7694c0c0/users/7b178256e7e5410d9784e61c94cd4f74/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.147718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698a41b-4f9a-47b2-8975-32687df4dc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81bd41a7595412682d22a7a7694c0c0, user_id=7b178256e7e5410d9784e61c94cd4f74, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:55.152718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698a41b-4f9a-47b2-8975-32687df4dc23 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:55.192671 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 885/1795] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:55 2022] PUT /identity/v3/projects/e81bd41a7595412682d22a7a7694c0c0/users/7b178256e7e5410d9784e61c94cd4f74/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:55.203719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40055-1670-4dff-aec4-62430022026c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.204284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40055-1670-4dff-aec4-62430022026c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.205057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40055-1670-4dff-aec4-62430022026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.252949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-acf40055-1670-4dff-aec4-62430022026c None None] MFA Rules not processed for user `7b178256e7e5410d9784e61c94cd4f74`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:55.254374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-acf40055-1670-4dff-aec4-62430022026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:55.337206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 911/1796] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:55.342071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698a41b-4f9a-47b2-8975-32687df4dc23 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:55.349879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:55.423954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698a41b-4f9a-47b2-8975-32687df4dc23 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:55.429326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3e7f4-8621-47c1-9648-f1440e6f891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:55.430755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3e7f4-8621-47c1-9648-f1440e6f891d admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.431190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3e7f4-8621-47c1-9648-f1440e6f891d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.431666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3e7f4-8621-47c1-9648-f1440e6f891d admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.432681 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3e7f4-8621-47c1-9648-f1440e6f891d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:55.435102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3e7f4-8621-47c1-9648-f1440e6f891d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:55.479342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 886/1797] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:55 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:55.483764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40055-1670-4dff-aec4-62430022026c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:55.497879 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40055-1670-4dff-aec4-62430022026c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:55.540301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:55.574036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f17a9-4aa7-4728-a1e7-78ed73457a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:55.575185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f17a9-4aa7-4728-a1e7-78ed73457a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.575542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f17a9-4aa7-4728-a1e7-78ed73457a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.575894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f17a9-4aa7-4728-a1e7-78ed73457a1b admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.576674 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f17a9-4aa7-4728-a1e7-78ed73457a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:55.579099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f17a9-4aa7-4728-a1e7-78ed73457a1b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:55.612957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 912/1798] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:55 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:55.615075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3e7f4-8621-47c1-9648-f1440e6f891d admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:55.632895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3e7f4-8621-47c1-9648-f1440e6f891d admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:55.647346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f2af8-d57a-40cd-86df-14ed0f9d437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:55.648067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f2af8-d57a-40cd-86df-14ed0f9d437e admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.648379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f2af8-d57a-40cd-86df-14ed0f9d437e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.648660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f2af8-d57a-40cd-86df-14ed0f9d437e admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.649403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f2af8-d57a-40cd-86df-14ed0f9d437e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:55.651223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9f2af8-d57a-40cd-86df-14ed0f9d437e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:55.667923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 887/1799] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:38:55.672088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f17a9-4aa7-4728-a1e7-78ed73457a1b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:55.687099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f17a9-4aa7-4728-a1e7-78ed73457a1b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:55.695691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdf670-97cd-42ab-8eb0-778479453f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:55.696944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf670-97cd-42ab-8eb0-778479453f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.697242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf670-97cd-42ab-8eb0-778479453f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.697730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf670-97cd-42ab-8eb0-778479453f0c admin admin] PATH_INFO: `/v3/projects/1650063fd7d54b1aa62f76b5f057aa8a/users/7fb2f1554f154644a58d7f23f06258e3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.724156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdf670-97cd-42ab-8eb0-778479453f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1650063fd7d54b1aa62f76b5f057aa8a, user_id=7fb2f1554f154644a58d7f23f06258e3, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:55.727657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdf670-97cd-42ab-8eb0-778479453f0c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:55.752715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 913/1800] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:55 2022] PUT /identity/v3/projects/1650063fd7d54b1aa62f76b5f057aa8a/users/7fb2f1554f154644a58d7f23f06258e3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:55.753787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f2af8-d57a-40cd-86df-14ed0f9d437e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:55.774831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f2af8-d57a-40cd-86df-14ed0f9d437e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:55.783623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daac31a-512f-4044-bd6c-b0594d530dcd None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.785422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daac31a-512f-4044-bd6c-b0594d530dcd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.785923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daac31a-512f-4044-bd6c-b0594d530dcd None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.789839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 914/1801] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:38:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:38:55.887587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42a568-1ee1-45ed-85b5-69d2ad2a1c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:55.888353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42a568-1ee1-45ed-85b5-69d2ad2a1c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.888709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42a568-1ee1-45ed-85b5-69d2ad2a1c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.889331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42a568-1ee1-45ed-85b5-69d2ad2a1c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.890480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42a568-1ee1-45ed-85b5-69d2ad2a1c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:55.891296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f822a0-c683-4d40-8885-f62bf10d22e8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.891585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f822a0-c683-4d40-8885-f62bf10d22e8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.891863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f822a0-c683-4d40-8885-f62bf10d22e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.893677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42a568-1ee1-45ed-85b5-69d2ad2a1c07 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:55.927233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-23f822a0-c683-4d40-8885-f62bf10d22e8 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:55.928464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-23f822a0-c683-4d40-8885-f62bf10d22e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:55.931929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 888/1802] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:55.935604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42a568-1ee1-45ed-85b5-69d2ad2a1c07 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:55.971191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42a568-1ee1-45ed-85b5-69d2ad2a1c07 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:55.979439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f2b07-6ff8-4c4a-ae14-c426a8596eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:55.980318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2b07-6ff8-4c4a-ae14-c426a8596eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:55.981124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2b07-6ff8-4c4a-ae14-c426a8596eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:55.981124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f2b07-6ff8-4c4a-ae14-c426a8596eae admin admin] PATH_INFO: `/v3/projects/1650063fd7d54b1aa62f76b5f057aa8a/users/7fb2f1554f154644a58d7f23f06258e3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:55.983101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f2b07-6ff8-4c4a-ae14-c426a8596eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1650063fd7d54b1aa62f76b5f057aa8a, user_id=7fb2f1554f154644a58d7f23f06258e3, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:55.987011 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f2b07-6ff8-4c4a-ae14-c426a8596eae admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:56.011191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 889/1803] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:55 2022] PUT /identity/v3/projects/1650063fd7d54b1aa62f76b5f057aa8a/users/7fb2f1554f154644a58d7f23f06258e3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:56.023060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a224d-207b-4ed1-a0cf-cb3590ecc8ab None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:56.023502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a224d-207b-4ed1-a0cf-cb3590ecc8ab None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:56.023868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a224d-207b-4ed1-a0cf-cb3590ecc8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:56.053423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 915/1804] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:38:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:56.071637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a71a224d-207b-4ed1-a0cf-cb3590ecc8ab None None] MFA Rules not processed for user `7fb2f1554f154644a58d7f23f06258e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:56.072996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a71a224d-207b-4ed1-a0cf-cb3590ecc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:56.146892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:56.236821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 890/1805] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:56.246958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f822a0-c683-4d40-8885-f62bf10d22e8 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:56.249772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-23f822a0-c683-4d40-8885-f62bf10d22e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:56.297204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a224d-207b-4ed1-a0cf-cb3590ecc8ab None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:56.298830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a71a224d-207b-4ed1-a0cf-cb3590ecc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:56.347753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f822a0-c683-4d40-8885-f62bf10d22e8 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:56.416386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a224d-207b-4ed1-a0cf-cb3590ecc8ab None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:56.422690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726921c2-880e-445e-9e13-0d862b7f5d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:56.423376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726921c2-880e-445e-9e13-0d862b7f5d43 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:56.423662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726921c2-880e-445e-9e13-0d862b7f5d43 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:56.423942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726921c2-880e-445e-9e13-0d862b7f5d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:56.427700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c175a7-f84a-499f-a6d0-dc7552c9dac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:56.428502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c175a7-f84a-499f-a6d0-dc7552c9dac7 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:56.428849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c175a7-f84a-499f-a6d0-dc7552c9dac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:56.429285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c175a7-f84a-499f-a6d0-dc7552c9dac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:56.434020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726921c2-880e-445e-9e13-0d862b7f5d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:56.435624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726921c2-880e-445e-9e13-0d862b7f5d43 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:56.437661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:56.443698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c175a7-f84a-499f-a6d0-dc7552c9dac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:56.450161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 891/1806] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:56.459409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c175a7-f84a-499f-a6d0-dc7552c9dac7 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:56.473435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 916/1807] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:56.523135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726921c2-880e-445e-9e13-0d862b7f5d43 service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:56.621718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726921c2-880e-445e-9e13-0d862b7f5d43 service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:56.627744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:56.628750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:56.629230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:56.629554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] PATH_INFO: `/v3/users/7b178256e7e5410d9784e61c94cd4f74` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:56.630929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b178256e7e5410d9784e61c94cd4f74)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:56.633137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:56.725107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b178256e7e5410d9784e61c94cd4f74'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:56.725818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b178256e7e5410d9784e61c94cd4f74'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:56.741064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b178256e7e5410d9784e61c94cd4f74'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:56.752567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b178256e7e5410d9784e61c94cd4f74'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:56.777471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:56.786119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b178256e7e5410d9784e61c94cd4f74'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:56.795511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 892/1808] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:56 2022] DELETE /identity/v3/users/7b178256e7e5410d9784e61c94cd4f74 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:56.804066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe03a9-c13f-4b53-ae24-f9787e117d4a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:56.804354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe03a9-c13f-4b53-ae24-f9787e117d4a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:56.805008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe03a9-c13f-4b53-ae24-f9787e117d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:56.857835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-65fe03a9-c13f-4b53-ae24-f9787e117d4a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:56.860608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-65fe03a9-c13f-4b53-ae24-f9787e117d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:56.962961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 917/1809] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:56.973809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:56.975726 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:57.050723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85839cd0-fefb-497b-b2a4-ee0237e581bd admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:57.054522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71de8d-0474-4345-8e1e-5b292bee8194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:57.055202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71de8d-0474-4345-8e1e-5b292bee8194 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:57.055481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71de8d-0474-4345-8e1e-5b292bee8194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:57.055756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71de8d-0474-4345-8e1e-5b292bee8194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:57.068171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71de8d-0474-4345-8e1e-5b292bee8194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:57.069604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71de8d-0474-4345-8e1e-5b292bee8194 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:57.081026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 893/1810] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:38:57.502613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe03a9-c13f-4b53-ae24-f9787e117d4a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:57.504145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-65fe03a9-c13f-4b53-ae24-f9787e117d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:57.516759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe03a9-c13f-4b53-ae24-f9787e117d4a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:57.522392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:57.523589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:57.523932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:57.524275 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] PATH_INFO: `/v3/projects/e81bd41a7595412682d22a7a7694c0c0` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:57.525680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81bd41a7595412682d22a7a7694c0c0)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:57.527782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:57.578161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81bd41a7595412682d22a7a7694c0c0', 'request_id': 'req-815038a5-ba51-461c-a9df-96e05195b4f4'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.586947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81bd41a7595412682d22a7a7694c0c0', 'request_id': 'req-815038a5-ba51-461c-a9df-96e05195b4f4'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.592750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81bd41a7595412682d22a7a7694c0c0', 'request_id': 'req-815038a5-ba51-461c-a9df-96e05195b4f4'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.603927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] The token cache is being invalidate because project e81bd41a7595412682d22a7a7694c0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:57.604217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.604862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.606547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 918/1811] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:57 2022] DELETE /identity/v3/projects/e81bd41a7595412682d22a7a7694c0c0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:57.610737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71de8d-0474-4345-8e1e-5b292bee8194 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:57.620779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71de8d-0474-4345-8e1e-5b292bee8194 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:57.680108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:57.680987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:57.681269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:57.681595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] PATH_INFO: `/v3/users/7fb2f1554f154644a58d7f23f06258e3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:57.682835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb2f1554f154644a58d7f23f06258e3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:57.684759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:57.732452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb2f1554f154644a58d7f23f06258e3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.733152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb2f1554f154644a58d7f23f06258e3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.742378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb2f1554f154644a58d7f23f06258e3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.750060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb2f1554f154644a58d7f23f06258e3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.762556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-1349671b-5905-499a-a050-58cc994b0503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb2f1554f154644a58d7f23f06258e3'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:57.768553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 894/1812] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:38:57 2022] DELETE /identity/v3/users/7fb2f1554f154644a58d7f23f06258e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:58.139426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:58.140936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:58.159722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815038a5-ba51-461c-a9df-96e05195b4f4 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:58.230847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:58.231721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.232000 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.232366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] PATH_INFO: `/v3/projects/1650063fd7d54b1aa62f76b5f057aa8a` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.233444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1650063fd7d54b1aa62f76b5f057aa8a)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:58.235526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:58.264694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:58.295080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1650063fd7d54b1aa62f76b5f057aa8a', 'request_id': 'req-97e121b8-bf19-4295-b925-862a1721952b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:58.304955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1650063fd7d54b1aa62f76b5f057aa8a', 'request_id': 'req-97e121b8-bf19-4295-b925-862a1721952b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:58.311781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1650063fd7d54b1aa62f76b5f057aa8a', 'request_id': 'req-97e121b8-bf19-4295-b925-862a1721952b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:58.324351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] The token cache is being invalidate because project 1650063fd7d54b1aa62f76b5f057aa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:38:58.325147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:58.325816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-97e121b8-bf19-4295-b925-862a1721952b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:38:58.327451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 919/1813] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:38:58 2022] DELETE /identity/v3/projects/1650063fd7d54b1aa62f76b5f057aa8a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:58.332555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d050-ca92-48ba-bbcc-a1ec55a9c226 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.332849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d050-ca92-48ba-bbcc-a1ec55a9c226 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.333145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307d050-ca92-48ba-bbcc-a1ec55a9c226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.365053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a307d050-ca92-48ba-bbcc-a1ec55a9c226 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:58.366401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a307d050-ca92-48ba-bbcc-a1ec55a9c226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:58.377638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:58.432311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 895/1814] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:38:58.439860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f61fd-5335-476d-afd2-eb8247185064 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.440268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f61fd-5335-476d-afd2-eb8247185064 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.440657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f61fd-5335-476d-afd2-eb8247185064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.460428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-fd8f61fd-5335-476d-afd2-eb8247185064 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:58.461788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fd8f61fd-5335-476d-afd2-eb8247185064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:58.469937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 920/1815] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:58.474357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d050-ca92-48ba-bbcc-a1ec55a9c226 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:58.485245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307d050-ca92-48ba-bbcc-a1ec55a9c226 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:58.490541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:58.491307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.491785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.492318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.493536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:38:58.493536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:58.494980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:58.512519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 896/1816] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:38:58.513510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f61fd-5335-476d-afd2-eb8247185064 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:58.527094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f61fd-5335-476d-afd2-eb8247185064 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:58.532397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f6260-a1f6-46fb-ab61-95071c8c05c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:58.533063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6260-a1f6-46fb-ab61-95071c8c05c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.533344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6260-a1f6-46fb-ab61-95071c8c05c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.533618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f6260-a1f6-46fb-ab61-95071c8c05c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.534356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f6260-a1f6-46fb-ab61-95071c8c05c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:58.536260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f6260-a1f6-46fb-ab61-95071c8c05c0 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:58.572739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 921/1817] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:58 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:58.574009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:58.584900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c2ae6-992b-4764-855c-5eaa7be092a8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:58.655773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff245b3-0720-4024-9806-5ec8953dac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:58.656460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff245b3-0720-4024-9806-5ec8953dac49 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.656738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff245b3-0720-4024-9806-5ec8953dac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.657005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff245b3-0720-4024-9806-5ec8953dac49 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.657710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff245b3-0720-4024-9806-5ec8953dac49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:58.659695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff245b3-0720-4024-9806-5ec8953dac49 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:58.684404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 897/1818] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:58 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:58.685988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f6260-a1f6-46fb-ab61-95071c8c05c0 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:58.696607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f6260-a1f6-46fb-ab61-95071c8c05c0 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:58.701475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24811d8a-2a84-48fd-a784-d5f41d399263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:58.702165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24811d8a-2a84-48fd-a784-d5f41d399263 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.702448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24811d8a-2a84-48fd-a784-d5f41d399263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.702744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24811d8a-2a84-48fd-a784-d5f41d399263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.703452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24811d8a-2a84-48fd-a784-d5f41d399263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:58.705046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24811d8a-2a84-48fd-a784-d5f41d399263 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:58.715853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 922/1819] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:58.720139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff245b3-0720-4024-9806-5ec8953dac49 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:58.730667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff245b3-0720-4024-9806-5ec8953dac49 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:58.735284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a48f5-fba5-480a-ba41-806e137c5cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:58.735975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a48f5-fba5-480a-ba41-806e137c5cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.736254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a48f5-fba5-480a-ba41-806e137c5cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.736521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a48f5-fba5-480a-ba41-806e137c5cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.737251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a48f5-fba5-480a-ba41-806e137c5cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:58.738901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a48f5-fba5-480a-ba41-806e137c5cdf admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:58.751347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 898/1820] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:58.755698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24811d8a-2a84-48fd-a784-d5f41d399263 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:58.765809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24811d8a-2a84-48fd-a784-d5f41d399263 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:58.770857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da1399-07f2-4d25-a1b6-7a4bd6bbad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:58.771739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da1399-07f2-4d25-a1b6-7a4bd6bbad5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.772018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da1399-07f2-4d25-a1b6-7a4bd6bbad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.772295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da1399-07f2-4d25-a1b6-7a4bd6bbad5d admin admin] PATH_INFO: `/v3/projects/cb4d13427f804d16bb535f7c305aec3b/users/bdfa4cc79eda4cf2ab3859db6f462114/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.787313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da1399-07f2-4d25-a1b6-7a4bd6bbad5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4d13427f804d16bb535f7c305aec3b, user_id=bdfa4cc79eda4cf2ab3859db6f462114, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:58.790172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da1399-07f2-4d25-a1b6-7a4bd6bbad5d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:58.806066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 923/1821] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:58 2022] PUT /identity/v3/projects/cb4d13427f804d16bb535f7c305aec3b/users/bdfa4cc79eda4cf2ab3859db6f462114/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:58.816579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a565f5-7d14-4ef1-9bcc-ff1e92bdd1a5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.816873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a565f5-7d14-4ef1-9bcc-ff1e92bdd1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.817151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a565f5-7d14-4ef1-9bcc-ff1e92bdd1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.845077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c4a565f5-7d14-4ef1-9bcc-ff1e92bdd1a5 None None] MFA Rules not processed for user `bdfa4cc79eda4cf2ab3859db6f462114`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:58.846326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c4a565f5-7d14-4ef1-9bcc-ff1e92bdd1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:58.913666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 899/1822] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:58.922876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da1399-07f2-4d25-a1b6-7a4bd6bbad5d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:58.990385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da1399-07f2-4d25-a1b6-7a4bd6bbad5d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:58.996165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f195701-d617-43fc-8e6f-97d108548a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:58.996818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f195701-d617-43fc-8e6f-97d108548a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:58.997101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f195701-d617-43fc-8e6f-97d108548a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:58.997383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f195701-d617-43fc-8e6f-97d108548a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:58.998101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f195701-d617-43fc-8e6f-97d108548a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.000012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f195701-d617-43fc-8e6f-97d108548a88 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.028618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 924/1823] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:58 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:59.033243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a565f5-7d14-4ef1-9bcc-ff1e92bdd1a5 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.047544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a565f5-7d14-4ef1-9bcc-ff1e92bdd1a5 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.052800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:59.112508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b0e74-8a0d-4f96-a068-9bd3bcda10a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.113185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b0e74-8a0d-4f96-a068-9bd3bcda10a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.113463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b0e74-8a0d-4f96-a068-9bd3bcda10a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.113733 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b0e74-8a0d-4f96-a068-9bd3bcda10a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.114507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b0e74-8a0d-4f96-a068-9bd3bcda10a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.116406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b0e74-8a0d-4f96-a068-9bd3bcda10a5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.138592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 900/1824] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:59 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:59.142504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f195701-d617-43fc-8e6f-97d108548a88 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.154329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f195701-d617-43fc-8e6f-97d108548a88 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.159034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c414f-a885-45d7-8c1d-347252bc2349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.159711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c414f-a885-45d7-8c1d-347252bc2349 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.159998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c414f-a885-45d7-8c1d-347252bc2349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.160276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c414f-a885-45d7-8c1d-347252bc2349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.161019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c414f-a885-45d7-8c1d-347252bc2349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.162710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c414f-a885-45d7-8c1d-347252bc2349 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.174673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 925/1825] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:59.179565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b0e74-8a0d-4f96-a068-9bd3bcda10a5 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.189808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b0e74-8a0d-4f96-a068-9bd3bcda10a5 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.196113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a32f-9049-462e-b690-4be876da1afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.196932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a32f-9049-462e-b690-4be876da1afa admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.197072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a32f-9049-462e-b690-4be876da1afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.197388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a32f-9049-462e-b690-4be876da1afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.198159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764a32f-9049-462e-b690-4be876da1afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.200115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764a32f-9049-462e-b690-4be876da1afa admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.222524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 901/1826] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:59.227737 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c414f-a885-45d7-8c1d-347252bc2349 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.239963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c414f-a885-45d7-8c1d-347252bc2349 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.245007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0117fd-1937-421e-8147-a3f3a2ee1346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.246070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0117fd-1937-421e-8147-a3f3a2ee1346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.246360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0117fd-1937-421e-8147-a3f3a2ee1346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.246793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0117fd-1937-421e-8147-a3f3a2ee1346 admin admin] PATH_INFO: `/v3/projects/6847c93dd21b404e9d6d4fe8c027114a/users/43cfa0b45e7b4a7fab16c77b15ef4d43/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.266325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0117fd-1937-421e-8147-a3f3a2ee1346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6847c93dd21b404e9d6d4fe8c027114a, user_id=43cfa0b45e7b4a7fab16c77b15ef4d43, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.269052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0117fd-1937-421e-8147-a3f3a2ee1346 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.271480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:59.288129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 926/1827] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:59 2022] PUT /identity/v3/projects/6847c93dd21b404e9d6d4fe8c027114a/users/43cfa0b45e7b4a7fab16c77b15ef4d43/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:38:59.299861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143ef6-7135-4991-b1be-c0314cceb0f2 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.300156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143ef6-7135-4991-b1be-c0314cceb0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.300440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20143ef6-7135-4991-b1be-c0314cceb0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.329926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-20143ef6-7135-4991-b1be-c0314cceb0f2 None None] MFA Rules not processed for user `43cfa0b45e7b4a7fab16c77b15ef4d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:38:59.331565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-20143ef6-7135-4991-b1be-c0314cceb0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:38:59.438098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 902/1828] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:38:59.442558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0117fd-1937-421e-8147-a3f3a2ee1346 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.505709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0117fd-1937-421e-8147-a3f3a2ee1346 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.512368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce976f23-f87e-4e5b-9093-e15228559dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.513136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce976f23-f87e-4e5b-9093-e15228559dff admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.513496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce976f23-f87e-4e5b-9093-e15228559dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.513830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce976f23-f87e-4e5b-9093-e15228559dff admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.514646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce976f23-f87e-4e5b-9093-e15228559dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.516625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce976f23-f87e-4e5b-9093-e15228559dff admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.563733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 927/1829] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:38:59 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:38:59.566069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143ef6-7135-4991-b1be-c0314cceb0f2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.607146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20143ef6-7135-4991-b1be-c0314cceb0f2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.700579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b53e-9886-4d75-8ccf-8f4491c5963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.702113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b53e-9886-4d75-8ccf-8f4491c5963a admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.702585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b53e-9886-4d75-8ccf-8f4491c5963a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.702867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7b53e-9886-4d75-8ccf-8f4491c5963a admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.703589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b53e-9886-4d75-8ccf-8f4491c5963a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.705539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7b53e-9886-4d75-8ccf-8f4491c5963a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.740103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 903/1830] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:38:59 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:38:59.741403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce976f23-f87e-4e5b-9093-e15228559dff admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.756014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce976f23-f87e-4e5b-9093-e15228559dff admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.762701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473a9d5-40a0-42e1-a5c1-67a6a5572f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.763537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473a9d5-40a0-42e1-a5c1-67a6a5572f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.763890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473a9d5-40a0-42e1-a5c1-67a6a5572f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.765286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473a9d5-40a0-42e1-a5c1-67a6a5572f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.766197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473a9d5-40a0-42e1-a5c1-67a6a5572f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.768198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473a9d5-40a0-42e1-a5c1-67a6a5572f04 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.785281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 928/1831] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:59.786474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b53e-9886-4d75-8ccf-8f4491c5963a admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.805129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7b53e-9886-4d75-8ccf-8f4491c5963a admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.823799 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbfeb0-bd17-4edb-995a-6d25d1e82fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.826037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbfeb0-bd17-4edb-995a-6d25d1e82fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.826037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbfeb0-bd17-4edb-995a-6d25d1e82fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.826037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbfeb0-bd17-4edb-995a-6d25d1e82fa4 admin admin] PATH_INFO: `/v3/projects/ef2edb3767d24b618ade203c20704213/users/9790adc87cfb46d1af7e74b317e3ead3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.828435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:38:59.845080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbfeb0-bd17-4edb-995a-6d25d1e82fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2edb3767d24b618ade203c20704213, user_id=9790adc87cfb46d1af7e74b317e3ead3, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.848345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbfeb0-bd17-4edb-995a-6d25d1e82fa4 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.879382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 904/1832] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:59 2022] PUT /identity/v3/projects/ef2edb3767d24b618ade203c20704213/users/9790adc87cfb46d1af7e74b317e3ead3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:38:59.883736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473a9d5-40a0-42e1-a5c1-67a6a5572f04 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.894608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473a9d5-40a0-42e1-a5c1-67a6a5572f04 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:38:59.960351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c753a6-4cfe-4500-8842-db8a3db815dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:38:59.961135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c753a6-4cfe-4500-8842-db8a3db815dd admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:38:59.961419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c753a6-4cfe-4500-8842-db8a3db815dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:38:59.961694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c753a6-4cfe-4500-8842-db8a3db815dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:38:59.962644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c753a6-4cfe-4500-8842-db8a3db815dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:38:59.964463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c753a6-4cfe-4500-8842-db8a3db815dd admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:38:59.976022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 929/1833] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:38:59.980245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbfeb0-bd17-4edb-995a-6d25d1e82fa4 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:38:59.996030 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbfeb0-bd17-4edb-995a-6d25d1e82fa4 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:00.004020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:00.004946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:00.005222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:00.005493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] PATH_INFO: `/v3/projects/ef2edb3767d24b618ade203c20704213/users/9790adc87cfb46d1af7e74b317e3ead3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:00.007582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2edb3767d24b618ade203c20704213, user_id=9790adc87cfb46d1af7e74b317e3ead3, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:00.010722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:00.021584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 905/1834] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:38:59 2022] PUT /identity/v3/projects/ef2edb3767d24b618ade203c20704213/users/9790adc87cfb46d1af7e74b317e3ead3/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:00.032399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde0161-b5a3-4ecf-9cc3-a4d3896a10ea None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:00.032688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde0161-b5a3-4ecf-9cc3-a4d3896a10ea None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:00.032965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde0161-b5a3-4ecf-9cc3-a4d3896a10ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:00.059789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-3cde0161-b5a3-4ecf-9cc3-a4d3896a10ea None None] MFA Rules not processed for user `9790adc87cfb46d1af7e74b317e3ead3`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:00.060989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3cde0161-b5a3-4ecf-9cc3-a4d3896a10ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:00.114090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:00.134238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 930/1835] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:00.145463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:00.147358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:00.208290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d30cb-bea2-45af-af6e-0319f5688484 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:00.213093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedef5f-0270-43d7-96c0-fdf18ef6faf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:00.213767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedef5f-0270-43d7-96c0-fdf18ef6faf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:00.214074 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedef5f-0270-43d7-96c0-fdf18ef6faf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:00.214352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedef5f-0270-43d7-96c0-fdf18ef6faf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:00.224058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedef5f-0270-43d7-96c0-fdf18ef6faf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:00.225580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedef5f-0270-43d7-96c0-fdf18ef6faf8 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:00.235996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 906/1836] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:00.274218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde0161-b5a3-4ecf-9cc3-a4d3896a10ea None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:00.275978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3cde0161-b5a3-4ecf-9cc3-a4d3896a10ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:00.289043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde0161-b5a3-4ecf-9cc3-a4d3896a10ea None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:00.292861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:00.293521 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:00.293859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:00.294261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:00.298633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:00.378226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:00.379601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:00.392044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 931/1837] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:00.804463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedef5f-0270-43d7-96c0-fdf18ef6faf8 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:00.813840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedef5f-0270-43d7-96c0-fdf18ef6faf8 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:00.821110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c77b9-dcac-40b6-be40-ab4a6a6c9390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:00.821813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c77b9-dcac-40b6-be40-ab4a6a6c9390 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:00.822172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c77b9-dcac-40b6-be40-ab4a6a6c9390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:00.822451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c77b9-dcac-40b6-be40-ab4a6a6c9390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:00.886835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c77b9-dcac-40b6-be40-ab4a6a6c9390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:00.888311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c77b9-dcac-40b6-be40-ab4a6a6c9390 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:00.898380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 907/1838] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:01.618731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:01.635144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19a51-2a2c-4d6c-9a87-3137065c71af service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:01.641609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:01.642517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:01.642959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:01.643396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:01.645899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:01.738329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:01.742567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:01.758596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 932/1839] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:10.894402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=66,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:11.751715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=65 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:15.850745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c77b9-dcac-40b6-be40-ab4a6a6c9390 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:15.860759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c77b9-dcac-40b6-be40-ab4a6a6c9390 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:15.864659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc63687-694e-4e3c-908e-85e74f06950c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:15.865332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63687-694e-4e3c-908e-85e74f06950c service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:15.865619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63687-694e-4e3c-908e-85e74f06950c service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:15.865897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc63687-694e-4e3c-908e-85e74f06950c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:16.008205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc63687-694e-4e3c-908e-85e74f06950c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:16.009773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc63687-694e-4e3c-908e-85e74f06950c service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:16.022502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 908/1840] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:16.580910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:16.583090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:16.754227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edcf9a-e9db-4175-98b2-12ae90644e33 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:16.760301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:16.761314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:16.761666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:16.762052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] PATH_INFO: `/v3/users/b3f3aa329459432fb57278613c13572f` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:16.764128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f3aa329459432fb57278613c13572f)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:16.767306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:16.846819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f3aa329459432fb57278613c13572f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:16.858251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f3aa329459432fb57278613c13572f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:16.858911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f3aa329459432fb57278613c13572f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:16.869224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f3aa329459432fb57278613c13572f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:16.884365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f3aa329459432fb57278613c13572f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:16.891001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 933/1841] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:16 2022] DELETE /identity/v3/users/b3f3aa329459432fb57278613c13572f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:16.896747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ff30-610c-4b2a-9e9c-af106aaf57d1 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:16.897654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ff30-610c-4b2a-9e9c-af106aaf57d1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:16.898526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9ff30-610c-4b2a-9e9c-af106aaf57d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:16.922864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c5f9ff30-610c-4b2a-9e9c-af106aaf57d1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:16.924332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c5f9ff30-610c-4b2a-9e9c-af106aaf57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:17.002437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 909/1842] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:17.014874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:17.016450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:17.094363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531695f5-4321-43a3-8d51-a41450303040 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:17.098287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31cf8d-708a-48ea-b217-d35de92b7a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:17.099059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31cf8d-708a-48ea-b217-d35de92b7a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:17.099440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31cf8d-708a-48ea-b217-d35de92b7a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:17.100039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a31cf8d-708a-48ea-b217-d35de92b7a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:17.113774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31cf8d-708a-48ea-b217-d35de92b7a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:17.115413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a31cf8d-708a-48ea-b217-d35de92b7a6d service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:17.126330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 934/1843] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:17.415403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9ff30-610c-4b2a-9e9c-af106aaf57d1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:17.417001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c5f9ff30-610c-4b2a-9e9c-af106aaf57d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:17.429281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9ff30-610c-4b2a-9e9c-af106aaf57d1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:17.437867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:17.438797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:17.439087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:17.439346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] PATH_INFO: `/v3/projects/a02cd387f70a4e1283d28fbdf30cca79` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:17.440651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02cd387f70a4e1283d28fbdf30cca79)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:17.443054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:17.496349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02cd387f70a4e1283d28fbdf30cca79', 'request_id': 'req-92534259-4876-4437-b501-07add71f2fc0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.505256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02cd387f70a4e1283d28fbdf30cca79', 'request_id': 'req-92534259-4876-4437-b501-07add71f2fc0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.511015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02cd387f70a4e1283d28fbdf30cca79', 'request_id': 'req-92534259-4876-4437-b501-07add71f2fc0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.522411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] The token cache is being invalidate because project a02cd387f70a4e1283d28fbdf30cca79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:17.522701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.523360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.524955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 910/1844] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:17 2022] DELETE /identity/v3/projects/a02cd387f70a4e1283d28fbdf30cca79 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:17.529181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31cf8d-708a-48ea-b217-d35de92b7a6d service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:17.539440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a31cf8d-708a-48ea-b217-d35de92b7a6d service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:17.558836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:17.609832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:17.611249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:17.611672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:17.612113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] PATH_INFO: `/v3/users/07171037dc4b49438a3b543fe1fd4021` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:17.614077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07171037dc4b49438a3b543fe1fd4021)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:17.617510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:17.676761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07171037dc4b49438a3b543fe1fd4021'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.686035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07171037dc4b49438a3b543fe1fd4021'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.686656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07171037dc4b49438a3b543fe1fd4021'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.694941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07171037dc4b49438a3b543fe1fd4021'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.708638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-ef4e6a53-b2da-4850-9fb8-f12976e38dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07171037dc4b49438a3b543fe1fd4021'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:17.715366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 935/1845] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:17 2022] DELETE /identity/v3/users/07171037dc4b49438a3b543fe1fd4021 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:17.995340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:17.997475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:18.013997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92534259-4876-4437-b501-07add71f2fc0 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.039500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:18.091044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.091958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.092237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.092505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] PATH_INFO: `/v3/projects/35d3763a8a1d4a8bb17a9d5add45f6ea` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.093686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d3763a8a1d4a8bb17a9d5add45f6ea)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.095655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:18.167271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d3763a8a1d4a8bb17a9d5add45f6ea', 'request_id': 'req-b9dd34b4-8d80-4487-974f-b3c75adb39a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:18.179535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d3763a8a1d4a8bb17a9d5add45f6ea', 'request_id': 'req-b9dd34b4-8d80-4487-974f-b3c75adb39a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:18.186306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d3763a8a1d4a8bb17a9d5add45f6ea', 'request_id': 'req-b9dd34b4-8d80-4487-974f-b3c75adb39a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:18.198152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] The token cache is being invalidate because project 35d3763a8a1d4a8bb17a9d5add45f6ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:18.198449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:18.199111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b9dd34b4-8d80-4487-974f-b3c75adb39a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:18.201097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 911/1846] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:17 2022] DELETE /identity/v3/projects/35d3763a8a1d4a8bb17a9d5add45f6ea => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:18.207026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b26f-db11-4b60-b395-84277769ac11 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.207319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b26f-db11-4b60-b395-84277769ac11 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.208975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b26f-db11-4b60-b395-84277769ac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.226308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-0107b26f-db11-4b60-b395-84277769ac11 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:18.227636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0107b26f-db11-4b60-b395-84277769ac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:18.291584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 936/1847] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:18.301269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6e60-e90f-42a9-8315-3ce535c9d224 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.301664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6e60-e90f-42a9-8315-3ce535c9d224 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.302138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6e60-e90f-42a9-8315-3ce535c9d224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.324083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-74fc6e60-e90f-42a9-8315-3ce535c9d224 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:18.325750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-74fc6e60-e90f-42a9-8315-3ce535c9d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:18.334951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 912/1848] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:18.340863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b26f-db11-4b60-b395-84277769ac11 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:18.355877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b26f-db11-4b60-b395-84277769ac11 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.360867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.361521 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.361806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.362119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.362860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:39:18.363167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.364778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:18.376617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 937/1849] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:39:18.381019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc6e60-e90f-42a9-8315-3ce535c9d224 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:18.390529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc6e60-e90f-42a9-8315-3ce535c9d224 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.395327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542cfdc-a5e4-489d-a5de-8cd72570f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.395981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542cfdc-a5e4-489d-a5de-8cd72570f729 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.396264 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542cfdc-a5e4-489d-a5de-8cd72570f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.396540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542cfdc-a5e4-489d-a5de-8cd72570f729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.397251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542cfdc-a5e4-489d-a5de-8cd72570f729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.399203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542cfdc-a5e4-489d-a5de-8cd72570f729 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:18.427582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 913/1850] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:18 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:18.432507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:18.448395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc4ad1-6e34-4b06-9019-13cbf47eb38f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.475036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:18.507367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0bd56-a792-4286-939a-e96385525b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.508050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0bd56-a792-4286-939a-e96385525b6b admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.508332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0bd56-a792-4286-939a-e96385525b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.508603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed0bd56-a792-4286-939a-e96385525b6b admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.509338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0bd56-a792-4286-939a-e96385525b6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.511300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed0bd56-a792-4286-939a-e96385525b6b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:18.532481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 938/1851] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:18 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:18.536769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542cfdc-a5e4-489d-a5de-8cd72570f729 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:18.549216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542cfdc-a5e4-489d-a5de-8cd72570f729 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.554802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776985b8-aa96-4ff6-a749-9a96296535d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.555472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776985b8-aa96-4ff6-a749-9a96296535d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.555752 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776985b8-aa96-4ff6-a749-9a96296535d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.556048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776985b8-aa96-4ff6-a749-9a96296535d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.556775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776985b8-aa96-4ff6-a749-9a96296535d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.558429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776985b8-aa96-4ff6-a749-9a96296535d1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:18.569818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 914/1852] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:18.574267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0bd56-a792-4286-939a-e96385525b6b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:18.585384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed0bd56-a792-4286-939a-e96385525b6b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.591234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4279bc4a-84fe-4d57-811e-5824c7f289c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.591906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279bc4a-84fe-4d57-811e-5824c7f289c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.592187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279bc4a-84fe-4d57-811e-5824c7f289c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.592464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279bc4a-84fe-4d57-811e-5824c7f289c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.593210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279bc4a-84fe-4d57-811e-5824c7f289c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.594868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4279bc4a-84fe-4d57-811e-5824c7f289c2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:18.605208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 939/1853] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:18.609566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776985b8-aa96-4ff6-a749-9a96296535d1 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:18.620056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776985b8-aa96-4ff6-a749-9a96296535d1 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.625272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.626180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.626460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.626735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] PATH_INFO: `/v3/projects/1a4e6b63ce2c46c69cef9a5db7ed7c61/users/a9defe185e914b41a9de5e8a3f1867ea/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.641803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a4e6b63ce2c46c69cef9a5db7ed7c61, user_id=a9defe185e914b41a9de5e8a3f1867ea, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.644506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:18.659975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 915/1854] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:18 2022] PUT /identity/v3/projects/1a4e6b63ce2c46c69cef9a5db7ed7c61/users/a9defe185e914b41a9de5e8a3f1867ea/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:18.672485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb998f-f4d4-404f-9ff4-b7211c38f684 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.672988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb998f-f4d4-404f-9ff4-b7211c38f684 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.673499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb998f-f4d4-404f-9ff4-b7211c38f684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.702416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c5cb998f-f4d4-404f-9ff4-b7211c38f684 None None] MFA Rules not processed for user `a9defe185e914b41a9de5e8a3f1867ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:18.703569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c5cb998f-f4d4-404f-9ff4-b7211c38f684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:18.774168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 940/1855] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:18.786277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:18.788079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:18.848496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:18.853416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1cecf-b889-4ccb-ae9e-2f906d60210b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.859080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d04515-67c3-440e-96ab-9624de9d9f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.860144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04515-67c3-440e-96ab-9624de9d9f30 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.860674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04515-67c3-440e-96ab-9624de9d9f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.861476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d04515-67c3-440e-96ab-9624de9d9f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.871069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d04515-67c3-440e-96ab-9624de9d9f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.872902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d04515-67c3-440e-96ab-9624de9d9f30 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:18.882883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 916/1856] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:18.902451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb998f-f4d4-404f-9ff4-b7211c38f684 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:18.966961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb998f-f4d4-404f-9ff4-b7211c38f684 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:18.971637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:18.972558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:18.972840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:18.973115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] PATH_INFO: `/v3/users/a9defe185e914b41a9de5e8a3f1867ea` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:18.974358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9defe185e914b41a9de5e8a3f1867ea)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:18.976326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:19.022660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:19.029583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9defe185e914b41a9de5e8a3f1867ea'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.043164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9defe185e914b41a9de5e8a3f1867ea'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.043792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9defe185e914b41a9de5e8a3f1867ea'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.060860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9defe185e914b41a9de5e8a3f1867ea'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.073747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9defe185e914b41a9de5e8a3f1867ea'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.080272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 941/1857] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:18 2022] DELETE /identity/v3/users/a9defe185e914b41a9de5e8a3f1867ea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:39:19.085594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf34e9-1cce-4e5b-aa61-a3908c026ce1 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:19.086081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf34e9-1cce-4e5b-aa61-a3908c026ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:19.086192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf34e9-1cce-4e5b-aa61-a3908c026ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:19.107556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-4eaf34e9-1cce-4e5b-aa61-a3908c026ce1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:19.108756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4eaf34e9-1cce-4e5b-aa61-a3908c026ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:19.169754 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 917/1858] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:19.178972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:19.185970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:19.275547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81cc91-92b3-4ce1-bd6c-d39e3c1c666e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:19.279367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbfc674-5f5d-429e-8212-ad6efbd7fd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:19.280022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfc674-5f5d-429e-8212-ad6efbd7fd94 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:19.280422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfc674-5f5d-429e-8212-ad6efbd7fd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:19.280707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbfc674-5f5d-429e-8212-ad6efbd7fd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:19.291762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfc674-5f5d-429e-8212-ad6efbd7fd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:19.293204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbfc674-5f5d-429e-8212-ad6efbd7fd94 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:19.305501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 942/1859] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:19.585340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf34e9-1cce-4e5b-aa61-a3908c026ce1 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:19.587840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4eaf34e9-1cce-4e5b-aa61-a3908c026ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:19.605611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf34e9-1cce-4e5b-aa61-a3908c026ce1 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:19.611434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:19.612375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:19.612620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:19.612889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] PATH_INFO: `/v3/projects/1a4e6b63ce2c46c69cef9a5db7ed7c61` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:19.614315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a4e6b63ce2c46c69cef9a5db7ed7c61)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:19.616325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:19.664309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4e6b63ce2c46c69cef9a5db7ed7c61', 'request_id': 'req-02dfe8b3-9bd5-4823-a852-202700324fa2'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.672488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4e6b63ce2c46c69cef9a5db7ed7c61', 'request_id': 'req-02dfe8b3-9bd5-4823-a852-202700324fa2'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.677974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4e6b63ce2c46c69cef9a5db7ed7c61', 'request_id': 'req-02dfe8b3-9bd5-4823-a852-202700324fa2'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.688891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] The token cache is being invalidate because project 1a4e6b63ce2c46c69cef9a5db7ed7c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:19.689181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.689807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-02dfe8b3-9bd5-4823-a852-202700324fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:19.691404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 918/1860] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:19 2022] DELETE /identity/v3/projects/1a4e6b63ce2c46c69cef9a5db7ed7c61 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:19.696519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7365a-3953-4e3f-8e96-dfb154dcb6c3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:19.697020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7365a-3953-4e3f-8e96-dfb154dcb6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:19.697114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7365a-3953-4e3f-8e96-dfb154dcb6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:19.716519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-30e7365a-3953-4e3f-8e96-dfb154dcb6c3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:19.717635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-30e7365a-3953-4e3f-8e96-dfb154dcb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:19.797168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 943/1861] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:19.809903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621072-3067-4d24-95a5-112f58f6eeb4 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:19.810235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621072-3067-4d24-95a5-112f58f6eeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:19.810511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621072-3067-4d24-95a5-112f58f6eeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:19.830479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a8621072-3067-4d24-95a5-112f58f6eeb4 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:19.831675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a8621072-3067-4d24-95a5-112f58f6eeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:19.841364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 919/1862] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:19.845894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7365a-3953-4e3f-8e96-dfb154dcb6c3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:19.856487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7365a-3953-4e3f-8e96-dfb154dcb6c3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:19.861772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:19.862476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:19.862762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:19.863040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:19.863788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:39:19.864099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:19.865733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:19.878237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 944/1863] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:39:19.882645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8621072-3067-4d24-95a5-112f58f6eeb4 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:19.891888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8621072-3067-4d24-95a5-112f58f6eeb4 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:19.897087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5edc1-4749-4665-8c09-57a4e93a1a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:19.897736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5edc1-4749-4665-8c09-57a4e93a1a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:19.898220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5edc1-4749-4665-8c09-57a4e93a1a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:19.898608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5edc1-4749-4665-8c09-57a4e93a1a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:19.899325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5edc1-4749-4665-8c09-57a4e93a1a87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:19.901258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5edc1-4749-4665-8c09-57a4e93a1a87 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:19.931805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 920/1864] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:19 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:19.936130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:19.946958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cba9d-c078-4565-bffe-4aa8c5461881 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:19.992444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:20.006183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72ff4-5b3c-4dba-988b-1c22017e50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:20.006854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72ff4-5b3c-4dba-988b-1c22017e50c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:20.007150 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72ff4-5b3c-4dba-988b-1c22017e50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:20.007423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f72ff4-5b3c-4dba-988b-1c22017e50c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:20.008157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f72ff4-5b3c-4dba-988b-1c22017e50c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:20.010128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f72ff4-5b3c-4dba-988b-1c22017e50c1 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:20.030798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 945/1865] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:19 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:20.035163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5edc1-4749-4665-8c09-57a4e93a1a87 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:20.046029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5edc1-4749-4665-8c09-57a4e93a1a87 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:20.051871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dab26-996c-4882-be67-a2feb83e79bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:20.052532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dab26-996c-4882-be67-a2feb83e79bd admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:20.052855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dab26-996c-4882-be67-a2feb83e79bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:20.053122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24dab26-996c-4882-be67-a2feb83e79bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:20.053856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dab26-996c-4882-be67-a2feb83e79bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:20.055518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24dab26-996c-4882-be67-a2feb83e79bd admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:20.068043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 921/1866] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:20.070921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72ff4-5b3c-4dba-988b-1c22017e50c1 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:20.083853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f72ff4-5b3c-4dba-988b-1c22017e50c1 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:20.088975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92e645-0e12-40da-94a3-2e5583d469b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:20.089730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e645-0e12-40da-94a3-2e5583d469b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:20.090120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e645-0e12-40da-94a3-2e5583d469b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:20.090476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e645-0e12-40da-94a3-2e5583d469b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:20.091288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92e645-0e12-40da-94a3-2e5583d469b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:20.093014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92e645-0e12-40da-94a3-2e5583d469b1 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:20.103911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 946/1867] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:20.108110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dab26-996c-4882-be67-a2feb83e79bd admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:20.118527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24dab26-996c-4882-be67-a2feb83e79bd admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:20.123303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:20.124359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:20.124749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:20.125127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] PATH_INFO: `/v3/projects/fd410d5a356243c6b7b71cfb958fcdfc/users/c8d8523e71264696997f23122115687a/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:20.140419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd410d5a356243c6b7b71cfb958fcdfc, user_id=c8d8523e71264696997f23122115687a, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:20.143155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:20.162354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 922/1868] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:20 2022] PUT /identity/v3/projects/fd410d5a356243c6b7b71cfb958fcdfc/users/c8d8523e71264696997f23122115687a/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:20.167781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29b1e3-7857-4f9d-bb4d-2feddeb2b7a6 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:20.168289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29b1e3-7857-4f9d-bb4d-2feddeb2b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:20.168572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29b1e3-7857-4f9d-bb4d-2feddeb2b7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:20.186638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1a29b1e3-7857-4f9d-bb4d-2feddeb2b7a6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:20.187866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1a29b1e3-7857-4f9d-bb4d-2feddeb2b7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:20.252098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 947/1869] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:20.263229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:20.273914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:20.301053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:20.355968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b31c3-6f65-4e6c-92e9-f4f100a73a25 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:20.359621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:20.360273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:20.360553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:20.360825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:20.370761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:20.372198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:20.382145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 923/1870] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:21.040863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf323d-d27b-45a1-b007-961a4b3af8fe None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:21.041384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf323d-d27b-45a1-b007-961a4b3af8fe None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:21.041384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf323d-d27b-45a1-b007-961a4b3af8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:21.069864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e1cf323d-d27b-45a1-b007-961a4b3af8fe None None] MFA Rules not processed for user `c8d8523e71264696997f23122115687a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:21.071129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e1cf323d-d27b-45a1-b007-961a4b3af8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:21.141375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 948/1871] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:21.152988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:21.154581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:21.211190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f34a54-7c4e-4de1-934b-50a948848867 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:21.215425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9cad8e-22da-4a6b-a8ea-632f054ee685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:21.216068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cad8e-22da-4a6b-a8ea-632f054ee685 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:21.216377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cad8e-22da-4a6b-a8ea-632f054ee685 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:21.216681 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9cad8e-22da-4a6b-a8ea-632f054ee685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:21.225406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cad8e-22da-4a6b-a8ea-632f054ee685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:21.227207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9cad8e-22da-4a6b-a8ea-632f054ee685 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:21.236076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 924/1872] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:23.160974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e386-dfa8-4506-9f34-f53e749553c6 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:23.161582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e386-dfa8-4506-9f34-f53e749553c6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:23.161821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285e386-dfa8-4506-9f34-f53e749553c6 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:23.163591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 949/1873] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:39:23.174593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a4ba-6215-439f-931e-212ef794ae64 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:23.175071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a4ba-6215-439f-931e-212ef794ae64 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:23.175071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a4ba-6215-439f-931e-212ef794ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:23.195607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1524a4ba-6215-439f-931e-212ef794ae64 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:23.197142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1524a4ba-6215-439f-931e-212ef794ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:23.324634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 925/1874] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:39:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:23.337186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285e386-dfa8-4506-9f34-f53e749553c6 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:23.340061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e285e386-dfa8-4506-9f34-f53e749553c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:23.358032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285e386-dfa8-4506-9f34-f53e749553c6 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:23.363844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:23.364736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:23.365181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:23.365476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:23.376177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:23.377838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:23.389452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 950/1875] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:23.676330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371aca-183e-4f59-b707-012f35a9a280 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:23.676621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371aca-183e-4f59-b707-012f35a9a280 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:23.676900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371aca-183e-4f59-b707-012f35a9a280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:23.699924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-df371aca-183e-4f59-b707-012f35a9a280 None None] MFA Rules not processed for user `c8d8523e71264696997f23122115687a`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:23.701436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-df371aca-183e-4f59-b707-012f35a9a280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:23.710585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 926/1876] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:23.839951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:23.841623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:23.887079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde1671-7757-48ee-a31f-6c5b8d4e6717 service nova] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:23.898729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:23.900024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:23.900434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:23.900929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] PATH_INFO: `/v3/users/bdfa4cc79eda4cf2ab3859db6f462114` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:23.903272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdfa4cc79eda4cf2ab3859db6f462114)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:23.911151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:23.966492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:23.977018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdfa4cc79eda4cf2ab3859db6f462114'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:23.985906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdfa4cc79eda4cf2ab3859db6f462114'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:23.986608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdfa4cc79eda4cf2ab3859db6f462114'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:23.994635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdfa4cc79eda4cf2ab3859db6f462114'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.012697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdfa4cc79eda4cf2ab3859db6f462114'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.019816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 951/1877] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:23 2022] DELETE /identity/v3/users/bdfa4cc79eda4cf2ab3859db6f462114 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:24.024387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d7340-7b07-4f12-86fd-1a269e76956b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:24.024695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d7340-7b07-4f12-86fd-1a269e76956b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:24.024972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d7340-7b07-4f12-86fd-1a269e76956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:24.043866 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-926d7340-7b07-4f12-86fd-1a269e76956b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:24.045100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-926d7340-7b07-4f12-86fd-1a269e76956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:24.100761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:24.120807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 927/1878] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:24.130514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:24.131923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:24.189870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c438b-80f0-44f6-bf47-f7931bb2dcda admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:24.194027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86325e23-583e-4a9b-a1c8-1f9c1e2c328a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:24.194712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86325e23-583e-4a9b-a1c8-1f9c1e2c328a service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:24.194993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86325e23-583e-4a9b-a1c8-1f9c1e2c328a service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:24.195255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86325e23-583e-4a9b-a1c8-1f9c1e2c328a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:24.206382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86325e23-583e-4a9b-a1c8-1f9c1e2c328a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:24.207827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86325e23-583e-4a9b-a1c8-1f9c1e2c328a service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:24.223038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 952/1879] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:24.701026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d7340-7b07-4f12-86fd-1a269e76956b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:24.702877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-926d7340-7b07-4f12-86fd-1a269e76956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:24.727455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d7340-7b07-4f12-86fd-1a269e76956b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:24.735951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:24.737146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:24.737650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:24.738129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] PATH_INFO: `/v3/projects/cb4d13427f804d16bb535f7c305aec3b` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:24.740601 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4d13427f804d16bb535f7c305aec3b)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:24.743654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:24.808202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4d13427f804d16bb535f7c305aec3b', 'request_id': 'req-063755e3-c333-46ec-b620-1d39dfb2e5af'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.819647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4d13427f804d16bb535f7c305aec3b', 'request_id': 'req-063755e3-c333-46ec-b620-1d39dfb2e5af'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.831203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4d13427f804d16bb535f7c305aec3b', 'request_id': 'req-063755e3-c333-46ec-b620-1d39dfb2e5af'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.842628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] The token cache is being invalidate because project cb4d13427f804d16bb535f7c305aec3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:24.843152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.843673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.845231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 928/1880] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:24 2022] DELETE /identity/v3/projects/cb4d13427f804d16bb535f7c305aec3b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:24.849347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86325e23-583e-4a9b-a1c8-1f9c1e2c328a service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:24.859016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86325e23-583e-4a9b-a1c8-1f9c1e2c328a service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:24.922771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:24.923666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:24.923945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:24.924218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] PATH_INFO: `/v3/users/43cfa0b45e7b4a7fab16c77b15ef4d43` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:24.925402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43cfa0b45e7b4a7fab16c77b15ef4d43)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:24.927371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:24.974445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43cfa0b45e7b4a7fab16c77b15ef4d43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.983643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43cfa0b45e7b4a7fab16c77b15ef4d43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.984395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43cfa0b45e7b4a7fab16c77b15ef4d43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:24.990210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:24.993623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43cfa0b45e7b4a7fab16c77b15ef4d43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.009415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43cfa0b45e7b4a7fab16c77b15ef4d43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.016108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 953/1881] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:24 2022] DELETE /identity/v3/users/43cfa0b45e7b4a7fab16c77b15ef4d43 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:25.324724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:25.326289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:25.346372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063755e3-c333-46ec-b620-1d39dfb2e5af admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:25.412461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:25.413365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:25.413738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:25.414052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] PATH_INFO: `/v3/projects/6847c93dd21b404e9d6d4fe8c027114a` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:25.415278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6847c93dd21b404e9d6d4fe8c027114a)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:25.417216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:25.465845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6847c93dd21b404e9d6d4fe8c027114a', 'request_id': 'req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.479836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6847c93dd21b404e9d6d4fe8c027114a', 'request_id': 'req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.485565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6847c93dd21b404e9d6d4fe8c027114a', 'request_id': 'req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.487467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:25.499224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] The token cache is being invalidate because project 6847c93dd21b404e9d6d4fe8c027114a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:25.499511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.500183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.501827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 929/1882] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:25 2022] DELETE /identity/v3/projects/6847c93dd21b404e9d6d4fe8c027114a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:25.506034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:25.507573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:25.521085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ffad5-c73b-4c78-a4aa-f53dafacbb3e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:25.580010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:25.580918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:25.581189 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:25.581471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] PATH_INFO: `/v3/users/9790adc87cfb46d1af7e74b317e3ead3` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:25.582745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9790adc87cfb46d1af7e74b317e3ead3)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:25.584723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:25.634425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9790adc87cfb46d1af7e74b317e3ead3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.643262 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9790adc87cfb46d1af7e74b317e3ead3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.643872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9790adc87cfb46d1af7e74b317e3ead3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.651347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9790adc87cfb46d1af7e74b317e3ead3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.663548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e790ae30-0201-45a3-b69f-33698797357a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9790adc87cfb46d1af7e74b317e3ead3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:25.669774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 954/1883] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:25 2022] DELETE /identity/v3/users/9790adc87cfb46d1af7e74b317e3ead3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:25.979667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:25.981393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:26.006815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14b402-cd5b-4d3d-91c6-b2de66e8d81a admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.067736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.068629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.068913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.069189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] PATH_INFO: `/v3/projects/ef2edb3767d24b618ade203c20704213` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.070570 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2edb3767d24b618ade203c20704213)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.072507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.120532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2edb3767d24b618ade203c20704213', 'request_id': 'req-bad98d59-1709-4528-8567-6e8416b4ee46'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:26.129658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2edb3767d24b618ade203c20704213', 'request_id': 'req-bad98d59-1709-4528-8567-6e8416b4ee46'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:26.135254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2edb3767d24b618ade203c20704213', 'request_id': 'req-bad98d59-1709-4528-8567-6e8416b4ee46'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:26.147050 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] The token cache is being invalidate because project ef2edb3767d24b618ade203c20704213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:26.147316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:26.148185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bad98d59-1709-4528-8567-6e8416b4ee46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:26.149935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 930/1884] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:25 2022] DELETE /identity/v3/projects/ef2edb3767d24b618ade203c20704213 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:26.156062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c718c0-1090-4c5a-ad34-1634422b8ac9 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.156357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c718c0-1090-4c5a-ad34-1634422b8ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.156638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c718c0-1090-4c5a-ad34-1634422b8ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.176114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-40c718c0-1090-4c5a-ad34-1634422b8ac9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:26.177350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-40c718c0-1090-4c5a-ad34-1634422b8ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:26.230044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:26.242988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 955/1885] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:26.252654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb12e-bcec-4d57-9e77-7e8066e8e738 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.253000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb12e-bcec-4d57-9e77-7e8066e8e738 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.253225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccb12e-bcec-4d57-9e77-7e8066e8e738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.273391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-32ccb12e-bcec-4d57-9e77-7e8066e8e738 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:26.274667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-32ccb12e-bcec-4d57-9e77-7e8066e8e738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:26.283680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 931/1886] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:26.288198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c718c0-1090-4c5a-ad34-1634422b8ac9 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.297895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c718c0-1090-4c5a-ad34-1634422b8ac9 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.302843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.303507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.303788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.304065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.304796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:39:26.305101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.306751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.319099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 956/1887] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:39:26.323526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccb12e-bcec-4d57-9e77-7e8066e8e738 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.333775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccb12e-bcec-4d57-9e77-7e8066e8e738 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.338545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039c48-5be8-472d-aee3-b38efcaeb574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.339223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039c48-5be8-472d-aee3-b38efcaeb574 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.339508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039c48-5be8-472d-aee3-b38efcaeb574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.339780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57039c48-5be8-472d-aee3-b38efcaeb574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.340480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039c48-5be8-472d-aee3-b38efcaeb574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.342463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57039c48-5be8-472d-aee3-b38efcaeb574 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.372980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 932/1888] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:26 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:26.374605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.384515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a97bc9-eb6e-497a-8979-b7a21463852d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.442322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51a6c-bfeb-4df6-bf6e-da3c9fe60558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.442993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51a6c-bfeb-4df6-bf6e-da3c9fe60558 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.443306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51a6c-bfeb-4df6-bf6e-da3c9fe60558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.443580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51a6c-bfeb-4df6-bf6e-da3c9fe60558 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.444304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51a6c-bfeb-4df6-bf6e-da3c9fe60558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.446343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51a6c-bfeb-4df6-bf6e-da3c9fe60558 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.468335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 957/1889] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:26 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:39:26.472605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039c48-5be8-472d-aee3-b38efcaeb574 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.483387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57039c48-5be8-472d-aee3-b38efcaeb574 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.488378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554f74-fa57-40cb-badb-0d28883e452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.489047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554f74-fa57-40cb-badb-0d28883e452c admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.489327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554f74-fa57-40cb-badb-0d28883e452c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.489599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c554f74-fa57-40cb-badb-0d28883e452c admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.490591 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c554f74-fa57-40cb-badb-0d28883e452c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.492205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c554f74-fa57-40cb-badb-0d28883e452c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.504324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 933/1890] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:26.508430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51a6c-bfeb-4df6-bf6e-da3c9fe60558 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.519894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51a6c-bfeb-4df6-bf6e-da3c9fe60558 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.525837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74572c8-7570-4da1-9994-dfc12646608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.526552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74572c8-7570-4da1-9994-dfc12646608c admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.526840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74572c8-7570-4da1-9994-dfc12646608c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.527116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74572c8-7570-4da1-9994-dfc12646608c admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.527861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74572c8-7570-4da1-9994-dfc12646608c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.529456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74572c8-7570-4da1-9994-dfc12646608c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.541020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 958/1891] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:26.545412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554f74-fa57-40cb-badb-0d28883e452c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.556450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c554f74-fa57-40cb-badb-0d28883e452c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.561642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bd4b5-622e-411f-bea0-74a4de903318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.562565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd4b5-622e-411f-bea0-74a4de903318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.562845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd4b5-622e-411f-bea0-74a4de903318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.563119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bd4b5-622e-411f-bea0-74a4de903318 admin admin] PATH_INFO: `/v3/projects/a2ef221a990f48db8b21cbcff612ff33/users/4f9d64b3cb064c49b0d499b2b70a7aae/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.579305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bd4b5-622e-411f-bea0-74a4de903318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ef221a990f48db8b21cbcff612ff33, user_id=4f9d64b3cb064c49b0d499b2b70a7aae, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.581993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bd4b5-622e-411f-bea0-74a4de903318 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.596728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 934/1892] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:26 2022] PUT /identity/v3/projects/a2ef221a990f48db8b21cbcff612ff33/users/4f9d64b3cb064c49b0d499b2b70a7aae/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:26.608379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daea7c-9e9f-434d-bc8b-6be26ba1e1de None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.608696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daea7c-9e9f-434d-bc8b-6be26ba1e1de None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.609002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daea7c-9e9f-434d-bc8b-6be26ba1e1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.643545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-86daea7c-9e9f-434d-bc8b-6be26ba1e1de None None] MFA Rules not processed for user `4f9d64b3cb064c49b0d499b2b70a7aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:26.644778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-86daea7c-9e9f-434d-bc8b-6be26ba1e1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:26.715474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 959/1893] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:26.720444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bd4b5-622e-411f-bea0-74a4de903318 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.746609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:26.788029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bd4b5-622e-411f-bea0-74a4de903318 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.793099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f2d8-8f1d-425a-a3b0-4fdfa9f0e6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.793761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f2d8-8f1d-425a-a3b0-4fdfa9f0e6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.794069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f2d8-8f1d-425a-a3b0-4fdfa9f0e6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.794338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4f2d8-8f1d-425a-a3b0-4fdfa9f0e6f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.795033 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f2d8-8f1d-425a-a3b0-4fdfa9f0e6f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.797278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4f2d8-8f1d-425a-a3b0-4fdfa9f0e6f6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.824685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 935/1894] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:26 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:26.829086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daea7c-9e9f-434d-bc8b-6be26ba1e1de None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.840533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daea7c-9e9f-434d-bc8b-6be26ba1e1de None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.890014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:26.901187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136d567-70b5-4a3e-9ecc-45d43f68b3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.901927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d567-70b5-4a3e-9ecc-45d43f68b3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.902461 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d567-70b5-4a3e-9ecc-45d43f68b3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.902574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136d567-70b5-4a3e-9ecc-45d43f68b3a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.903211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136d567-70b5-4a3e-9ecc-45d43f68b3a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.905242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136d567-70b5-4a3e-9ecc-45d43f68b3a7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.930933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 960/1895] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:26 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:26.935307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f2d8-8f1d-425a-a3b0-4fdfa9f0e6f6 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.945688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4f2d8-8f1d-425a-a3b0-4fdfa9f0e6f6 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.950747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f128-3b77-4aa9-a67d-4d721c6ef788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.951416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f128-3b77-4aa9-a67d-4d721c6ef788 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.951700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f128-3b77-4aa9-a67d-4d721c6ef788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.951979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d3f128-3b77-4aa9-a67d-4d721c6ef788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:26.952805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3f128-3b77-4aa9-a67d-4d721c6ef788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:26.954422 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d3f128-3b77-4aa9-a67d-4d721c6ef788 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:26.965385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 936/1896] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:26.970722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136d567-70b5-4a3e-9ecc-45d43f68b3a7 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:26.980899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136d567-70b5-4a3e-9ecc-45d43f68b3a7 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:26.986521 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc5098-b310-4625-935a-dddbbd025830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:26.987432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc5098-b310-4625-935a-dddbbd025830 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:26.987719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc5098-b310-4625-935a-dddbbd025830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:26.987995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc5098-b310-4625-935a-dddbbd025830 admin admin] PATH_INFO: `/v3/projects/c9f5bd7326c4440aabaed9e20b198952/users/38503e0886f4438e9eb2aecf9bfa4e93/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:27.003185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc5098-b310-4625-935a-dddbbd025830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f5bd7326c4440aabaed9e20b198952, user_id=38503e0886f4438e9eb2aecf9bfa4e93, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:27.005901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc5098-b310-4625-935a-dddbbd025830 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:27.026012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 961/1897] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:26 2022] PUT /identity/v3/projects/c9f5bd7326c4440aabaed9e20b198952/users/38503e0886f4438e9eb2aecf9bfa4e93/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:27.029870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f128-3b77-4aa9-a67d-4d721c6ef788 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:27.040283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d3f128-3b77-4aa9-a67d-4d721c6ef788 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:27.107127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602adfe0-b9cf-484f-8477-a684f2eb324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:27.107912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602adfe0-b9cf-484f-8477-a684f2eb324d admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:27.108483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602adfe0-b9cf-484f-8477-a684f2eb324d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:27.108850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602adfe0-b9cf-484f-8477-a684f2eb324d admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:27.109715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602adfe0-b9cf-484f-8477-a684f2eb324d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:27.111518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602adfe0-b9cf-484f-8477-a684f2eb324d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:27.124460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 937/1898] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:27.128805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc5098-b310-4625-935a-dddbbd025830 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:27.139934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc5098-b310-4625-935a-dddbbd025830 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:27.145611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:27.146616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:27.146958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:27.147294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] PATH_INFO: `/v3/projects/c9f5bd7326c4440aabaed9e20b198952/users/38503e0886f4438e9eb2aecf9bfa4e93/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:27.149567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f5bd7326c4440aabaed9e20b198952, user_id=38503e0886f4438e9eb2aecf9bfa4e93, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:27.152421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:27.164226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 962/1899] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:27 2022] PUT /identity/v3/projects/c9f5bd7326c4440aabaed9e20b198952/users/38503e0886f4438e9eb2aecf9bfa4e93/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:27.174738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f388efe-e67e-48ef-a0fb-9d00952f91d2 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:27.175100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f388efe-e67e-48ef-a0fb-9d00952f91d2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:27.175443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f388efe-e67e-48ef-a0fb-9d00952f91d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:27.202503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-6f388efe-e67e-48ef-a0fb-9d00952f91d2 None None] MFA Rules not processed for user `38503e0886f4438e9eb2aecf9bfa4e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:27.203689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6f388efe-e67e-48ef-a0fb-9d00952f91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:27.275008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 938/1900] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:27.286427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:27.288802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:27.355664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b213c-38f1-45a3-b65d-a4d3180a6c21 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:27.360389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8357203-61be-4a90-ba0a-dd2e72ad283d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:27.361048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357203-61be-4a90-ba0a-dd2e72ad283d service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:27.361409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357203-61be-4a90-ba0a-dd2e72ad283d service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:27.361812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8357203-61be-4a90-ba0a-dd2e72ad283d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:27.371554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8357203-61be-4a90-ba0a-dd2e72ad283d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:27.373008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8357203-61be-4a90-ba0a-dd2e72ad283d service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:27.383014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 963/1901] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:27.428992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f388efe-e67e-48ef-a0fb-9d00952f91d2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:27.430608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6f388efe-e67e-48ef-a0fb-9d00952f91d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:27.445362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f388efe-e67e-48ef-a0fb-9d00952f91d2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:27.450090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373eaf2c-b5a2-47f3-9d84-8ec41db68e2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:27.450845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eaf2c-b5a2-47f3-9d84-8ec41db68e2d service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:27.451049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eaf2c-b5a2-47f3-9d84-8ec41db68e2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:27.451262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373eaf2c-b5a2-47f3-9d84-8ec41db68e2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:27.467001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:27.515440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eaf2c-b5a2-47f3-9d84-8ec41db68e2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:27.517164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373eaf2c-b5a2-47f3-9d84-8ec41db68e2d service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:27.527318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 939/1902] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:33.357482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8357203-61be-4a90-ba0a-dd2e72ad283d service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:33.422118 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8357203-61be-4a90-ba0a-dd2e72ad283d service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:33.427239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:33.428166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:33.428450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:33.428727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] PATH_INFO: `/v3/users/4f9d64b3cb064c49b0d499b2b70a7aae` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:33.429925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9d64b3cb064c49b0d499b2b70a7aae)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:33.431908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:33.484213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9d64b3cb064c49b0d499b2b70a7aae'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:33.485901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:33.493650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9d64b3cb064c49b0d499b2b70a7aae'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:33.494396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9d64b3cb064c49b0d499b2b70a7aae'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:33.505471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9d64b3cb064c49b0d499b2b70a7aae'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:33.519255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9d64b3cb064c49b0d499b2b70a7aae'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:33.530223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 964/1903] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:33 2022] DELETE /identity/v3/users/4f9d64b3cb064c49b0d499b2b70a7aae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:33.535505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbad4d9-96c4-4cf9-8530-51ccd1ede73e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:33.536026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbad4d9-96c4-4cf9-8530-51ccd1ede73e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:33.536170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbad4d9-96c4-4cf9-8530-51ccd1ede73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:33.554787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5dbad4d9-96c4-4cf9-8530-51ccd1ede73e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:33.556118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5dbad4d9-96c4-4cf9-8530-51ccd1ede73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:33.620500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 940/1904] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:33.630319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:33.631805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:33.690039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a4a70-9f39-4a72-b663-7b15495a0ac2 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:33.693653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd74624-3acb-47a0-91d4-a2cf8b8a3845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:33.694334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd74624-3acb-47a0-91d4-a2cf8b8a3845 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:33.694612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd74624-3acb-47a0-91d4-a2cf8b8a3845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:33.695129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd74624-3acb-47a0-91d4-a2cf8b8a3845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:33.704995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd74624-3acb-47a0-91d4-a2cf8b8a3845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:33.706456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd74624-3acb-47a0-91d4-a2cf8b8a3845 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:33.716820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 965/1905] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:34.133763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbad4d9-96c4-4cf9-8530-51ccd1ede73e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:34.135267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5dbad4d9-96c4-4cf9-8530-51ccd1ede73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:34.147491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbad4d9-96c4-4cf9-8530-51ccd1ede73e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:34.152224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:34.153121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:34.153406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:34.153686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] PATH_INFO: `/v3/users/0830440d479a4579aa2807e51805919b` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:34.154928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0830440d479a4579aa2807e51805919b)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:34.157161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:34.210024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0830440d479a4579aa2807e51805919b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.210819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0830440d479a4579aa2807e51805919b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.220542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0830440d479a4579aa2807e51805919b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.228391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0830440d479a4579aa2807e51805919b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.241469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0830440d479a4579aa2807e51805919b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.248648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 941/1906] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:34 2022] DELETE /identity/v3/users/0830440d479a4579aa2807e51805919b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:34.255830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc690d57-f228-4485-9508-2fe96743e8fc None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:34.256248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc690d57-f228-4485-9508-2fe96743e8fc None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:34.256652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc690d57-f228-4485-9508-2fe96743e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:34.285606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-cc690d57-f228-4485-9508-2fe96743e8fc None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:34.287255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cc690d57-f228-4485-9508-2fe96743e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:34.299131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:34.300920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:34.350800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:34.378115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 966/1907] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:34.387956 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc690d57-f228-4485-9508-2fe96743e8fc None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:34.389598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cc690d57-f228-4485-9508-2fe96743e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:34.402738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a933b-3025-4006-9dcf-74d390126f43 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:34.408504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:34.409904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:34.410321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:34.411002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] PATH_INFO: `/v3/projects/a2ef221a990f48db8b21cbcff612ff33` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:34.413558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ef221a990f48db8b21cbcff612ff33)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:34.416493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:34.463757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc690d57-f228-4485-9508-2fe96743e8fc None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:34.483692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ef221a990f48db8b21cbcff612ff33', 'request_id': 'req-8f8304e5-252b-474d-86b0-848a9afd1c49'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.488289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ef221a990f48db8b21cbcff612ff33', 'request_id': 'req-8f8304e5-252b-474d-86b0-848a9afd1c49'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.492630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:34.494749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ef221a990f48db8b21cbcff612ff33', 'request_id': 'req-8f8304e5-252b-474d-86b0-848a9afd1c49'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.508162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] The token cache is being invalidate because project a2ef221a990f48db8b21cbcff612ff33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:34.508494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.509228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.510910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 942/1908] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:34 2022] DELETE /identity/v3/projects/a2ef221a990f48db8b21cbcff612ff33 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:34.515099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:34.516594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:34.529309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:34.529988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:34.530280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:34.530622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:34.532393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:34.583443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8304e5-252b-474d-86b0-848a9afd1c49 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:34.588390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:34.589303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:34.589588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:34.589858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] PATH_INFO: `/v3/users/38503e0886f4438e9eb2aecf9bfa4e93` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:34.591123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38503e0886f4438e9eb2aecf9bfa4e93)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:34.594049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:34.599056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:34.600496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:34.610497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 967/1909] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:39:34.795082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38503e0886f4438e9eb2aecf9bfa4e93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.795768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38503e0886f4438e9eb2aecf9bfa4e93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.805974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38503e0886f4438e9eb2aecf9bfa4e93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.814656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:34.822408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38503e0886f4438e9eb2aecf9bfa4e93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.839163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38503e0886f4438e9eb2aecf9bfa4e93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:34.845463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 943/1910] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:34 2022] DELETE /identity/v3/users/38503e0886f4438e9eb2aecf9bfa4e93 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:35.096127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.097639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:35.115894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9e34fd-6db4-4a5c-9590-6f0e24edb2c0 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.174987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.176602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:35.178952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.180145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.180440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.180762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] PATH_INFO: `/v3/projects/ddabecff4cf0462e8e486ce678f727e5` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.183684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddabecff4cf0462e8e486ce678f727e5)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.185677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.192118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872d2a1-e802-4b53-9168-cf9686a67965 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.197916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.202349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.202918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.203199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] PATH_INFO: `/v3/projects/c9f5bd7326c4440aabaed9e20b198952` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.204742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f5bd7326c4440aabaed9e20b198952)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.207172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.237711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddabecff4cf0462e8e486ce678f727e5', 'request_id': 'req-4be92300-2e9d-4828-a946-a9c62e7f2185'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.246417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddabecff4cf0462e8e486ce678f727e5', 'request_id': 'req-4be92300-2e9d-4828-a946-a9c62e7f2185'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.252420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddabecff4cf0462e8e486ce678f727e5', 'request_id': 'req-4be92300-2e9d-4828-a946-a9c62e7f2185'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.257626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f5bd7326c4440aabaed9e20b198952', 'request_id': 'req-9872a144-61e1-45ca-be83-ddfde8d49590'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.264187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] The token cache is being invalidate because project ddabecff4cf0462e8e486ce678f727e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:35.264452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.265115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.266888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 968/1911] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:35 2022] DELETE /identity/v3/projects/ddabecff4cf0462e8e486ce678f727e5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:35.267707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f5bd7326c4440aabaed9e20b198952', 'request_id': 'req-9872a144-61e1-45ca-be83-ddfde8d49590'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.270753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.272115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:35.275469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f5bd7326c4440aabaed9e20b198952', 'request_id': 'req-9872a144-61e1-45ca-be83-ddfde8d49590'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.278055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:35.289085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] The token cache is being invalidate because project c9f5bd7326c4440aabaed9e20b198952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:35.289729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.290254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9872a144-61e1-45ca-be83-ddfde8d49590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.292091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 944/1912] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:35 2022] DELETE /identity/v3/projects/c9f5bd7326c4440aabaed9e20b198952 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:35.296758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cd44-628b-42ba-86e0-1c22077b08aa None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.297149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cd44-628b-42ba-86e0-1c22077b08aa None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.297495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95cd44-628b-42ba-86e0-1c22077b08aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.319161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ad95cd44-628b-42ba-86e0-1c22077b08aa None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:35.320509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ad95cd44-628b-42ba-86e0-1c22077b08aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:35.352875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92300-2e9d-4828-a946-a9c62e7f2185 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.391710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 945/1913] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:35.402076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77fac5-d2e8-4087-b5b3-11ce800a5e73 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.403298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77fac5-d2e8-4087-b5b3-11ce800a5e73 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.403298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77fac5-d2e8-4087-b5b3-11ce800a5e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.422086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7c77fac5-d2e8-4087-b5b3-11ce800a5e73 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:35.423145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7c77fac5-d2e8-4087-b5b3-11ce800a5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:35.425931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.426866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.427152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.427438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] PATH_INFO: `/v3/users/78f34cd5f6d446eb87508162c026a85b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.428681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f34cd5f6d446eb87508162c026a85b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.430666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.435857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 946/1914] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:35.442420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77fac5-d2e8-4087-b5b3-11ce800a5e73 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.453787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77fac5-d2e8-4087-b5b3-11ce800a5e73 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.458906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.459641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.460053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.460341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.461104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:39:35.461413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.463231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.477148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 947/1915] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:39:35.481530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.491815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68afbb-e017-4be4-985e-c56fac545c8c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.496895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f34cd5f6d446eb87508162c026a85b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.498260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.499100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.499854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.500156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.501270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.503463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.505977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f34cd5f6d446eb87508162c026a85b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.506949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f34cd5f6d446eb87508162c026a85b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.516236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f34cd5f6d446eb87508162c026a85b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.531717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f34cd5f6d446eb87508162c026a85b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:35.545058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 948/1916] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:35 2022] POST /identity/v3/projects => generated 407 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:35.546457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.548166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:35.552120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 969/1917] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:35 2022] DELETE /identity/v3/users/78f34cd5f6d446eb87508162c026a85b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:35.570995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:35.635637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07350c6e-c2d5-4980-a8df-5c83f90be891 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.706399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b16a-b081-4312-b2b7-ef71fd558d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.707269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b16a-b081-4312-b2b7-ef71fd558d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.707656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b16a-b081-4312-b2b7-ef71fd558d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.708583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b16a-b081-4312-b2b7-ef71fd558d86 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.708946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4b16a-b081-4312-b2b7-ef71fd558d86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.711042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4b16a-b081-4312-b2b7-ef71fd558d86 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.740386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 949/1918] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:35 2022] POST /identity/v3/users => generated 304 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:35.740984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.766564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addfb1a-26a8-414b-a6f0-07ae765f1b52 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.777648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344607fc-064d-431d-b4b0-185ad30a40f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.778558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344607fc-064d-431d-b4b0-185ad30a40f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.778959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344607fc-064d-431d-b4b0-185ad30a40f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.779417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344607fc-064d-431d-b4b0-185ad30a40f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.780331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344607fc-064d-431d-b4b0-185ad30a40f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.782268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344607fc-064d-431d-b4b0-185ad30a40f1 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.798124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b16a-b081-4312-b2b7-ef71fd558d86 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.798355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 970/1919] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:35.810177 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b16a-b081-4312-b2b7-ef71fd558d86 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.816251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.817007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.817518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.817860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.818812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.820429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.832530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 950/1920] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:35.837116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344607fc-064d-431d-b4b0-185ad30a40f1 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.848383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344607fc-064d-431d-b4b0-185ad30a40f1 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.856882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f812-18f4-426a-a4f3-f51a5a01772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.858037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f812-18f4-426a-a4f3-f51a5a01772c admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.858414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f812-18f4-426a-a4f3-f51a5a01772c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.858756 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f812-18f4-426a-a4f3-f51a5a01772c admin admin] PATH_INFO: `/v3/projects/9e63c1e8dd31498697cb1d027191af39/users/cd341e52843e43a7a33e0de223e32b0e/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.878555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21f812-18f4-426a-a4f3-f51a5a01772c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e63c1e8dd31498697cb1d027191af39, user_id=cd341e52843e43a7a33e0de223e32b0e, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.881338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21f812-18f4-426a-a4f3-f51a5a01772c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:35.884758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:35.887545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:35.889660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:35.902545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 971/1921] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:35 2022] PUT /identity/v3/projects/9e63c1e8dd31498697cb1d027191af39/users/cd341e52843e43a7a33e0de223e32b0e/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:35.910315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a4f85-7bb0-46b4-a3f5-1124862a4be4 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:35.913458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00f469-f070-4034-952e-7ad895185cc5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.913782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00f469-f070-4034-952e-7ad895185cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.914192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00f469-f070-4034-952e-7ad895185cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.944992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-bd00f469-f070-4034-952e-7ad895185cc5 None None] MFA Rules not processed for user `cd341e52843e43a7a33e0de223e32b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:35.946283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bd00f469-f070-4034-952e-7ad895185cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:35.990340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:35.991252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:35.991489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:35.992279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] PATH_INFO: `/v3/projects/57014c747c2442a28d3f3fecafe68a01` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:35.993482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57014c747c2442a28d3f3fecafe68a01)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:35.996198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.019290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 972/1922] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:36.023884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00f469-f070-4034-952e-7ad895185cc5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.034933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00f469-f070-4034-952e-7ad895185cc5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.041864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:36.043286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57014c747c2442a28d3f3fecafe68a01', 'request_id': 'req-3145c475-2c82-4f62-88f3-ef780f1590f4'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:36.053356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57014c747c2442a28d3f3fecafe68a01', 'request_id': 'req-3145c475-2c82-4f62-88f3-ef780f1590f4'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:36.060529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57014c747c2442a28d3f3fecafe68a01', 'request_id': 'req-3145c475-2c82-4f62-88f3-ef780f1590f4'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:36.073132 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] The token cache is being invalidate because project 57014c747c2442a28d3f3fecafe68a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:36.073426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:36.074489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3145c475-2c82-4f62-88f3-ef780f1590f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:36.076443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 951/1923] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:35 2022] DELETE /identity/v3/projects/57014c747c2442a28d3f3fecafe68a01 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:39:36.082235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7b98-f86a-43e9-8c68-9c0957f37a27 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.083080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7b98-f86a-43e9-8c68-9c0957f37a27 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.083540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7b98-f86a-43e9-8c68-9c0957f37a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.103343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.105606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.106015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.106376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.107164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.108248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b92b7b98-f86a-43e9-8c68-9c0957f37a27 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:36.109810 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.110326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b92b7b98-f86a-43e9-8c68-9c0957f37a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:36.121345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 952/1924] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:36.129185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aebb77-0191-4c74-be9b-fd30840006b5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.129467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aebb77-0191-4c74-be9b-fd30840006b5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.129872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aebb77-0191-4c74-be9b-fd30840006b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.154771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 973/1925] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:36 2022] POST /identity/v3/projects => generated 409 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:39:36.154973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-27aebb77-0191-4c74-be9b-fd30840006b5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:36.154973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-27aebb77-0191-4c74-be9b-fd30840006b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:36.156893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.158533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:36.232640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b00758-6df1-4d37-ad43-7dcc015ce994 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.233806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 953/1926] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:36.238049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aebb77-0191-4c74-be9b-fd30840006b5 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.238208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8266f77-7e63-4800-bc1b-790b44188de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.239045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8266f77-7e63-4800-bc1b-790b44188de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.239386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8266f77-7e63-4800-bc1b-790b44188de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.239968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8266f77-7e63-4800-bc1b-790b44188de2 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.240492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8266f77-7e63-4800-bc1b-790b44188de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.242802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8266f77-7e63-4800-bc1b-790b44188de2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.247617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aebb77-0191-4c74-be9b-fd30840006b5 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.252500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.253247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.253532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.253925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.254632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:39:36.254963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.256636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.263623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:36.273662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 974/1927] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:36 2022] POST /identity/v3/users => generated 311 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:36.274474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 954/1928] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:39:36.276259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8266f77-7e63-4800-bc1b-790b44188de2 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.282853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.289256 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8266f77-7e63-4800-bc1b-790b44188de2 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.294920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e1f46-da2a-4a9b-9d02-66d358a30107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.295604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1f46-da2a-4a9b-9d02-66d358a30107 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.295895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1f46-da2a-4a9b-9d02-66d358a30107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.296276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e1f46-da2a-4a9b-9d02-66d358a30107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.297021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e1f46-da2a-4a9b-9d02-66d358a30107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.298124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ab5c3-8304-40fb-9c51-1b21f9fc9b32 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.298662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e1f46-da2a-4a9b-9d02-66d358a30107 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.306391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48d96b-0516-4940-8391-d791bbd689b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.307063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48d96b-0516-4940-8391-d791bbd689b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.307344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48d96b-0516-4940-8391-d791bbd689b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.308051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48d96b-0516-4940-8391-d791bbd689b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.308320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48d96b-0516-4940-8391-d791bbd689b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.319151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48d96b-0516-4940-8391-d791bbd689b1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.319356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 975/1929] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:36.319356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e1f46-da2a-4a9b-9d02-66d358a30107 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.324975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e1f46-da2a-4a9b-9d02-66d358a30107 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.330706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6524cf-1f73-4fc6-a761-be4d40c14c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.331721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6524cf-1f73-4fc6-a761-be4d40c14c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.332103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6524cf-1f73-4fc6-a761-be4d40c14c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.332386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6524cf-1f73-4fc6-a761-be4d40c14c76 admin admin] PATH_INFO: `/v3/projects/5249a5166a574be7b004f9dd373f34c0/users/26770bd3d97d4cf98a3f8308f0e4068f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.340619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 955/1930] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:36 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:36.344801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48d96b-0516-4940-8391-d791bbd689b1 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.348456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6524cf-1f73-4fc6-a761-be4d40c14c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5249a5166a574be7b004f9dd373f34c0, user_id=26770bd3d97d4cf98a3f8308f0e4068f, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.351243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6524cf-1f73-4fc6-a761-be4d40c14c76 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.369280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 976/1931] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:36 2022] PUT /identity/v3/projects/5249a5166a574be7b004f9dd373f34c0/users/26770bd3d97d4cf98a3f8308f0e4068f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:36.373486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6524cf-1f73-4fc6-a761-be4d40c14c76 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.406899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48d96b-0516-4940-8391-d791bbd689b1 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.436842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6524cf-1f73-4fc6-a761-be4d40c14c76 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.447206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a11b-9c7f-44da-ad46-1031b5addf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.447887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a11b-9c7f-44da-ad46-1031b5addf98 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.448141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a11b-9c7f-44da-ad46-1031b5addf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.448417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84a11b-9c7f-44da-ad46-1031b5addf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.449541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84a11b-9c7f-44da-ad46-1031b5addf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.450582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:36.451190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84a11b-9c7f-44da-ad46-1031b5addf98 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.469489 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 977/1932] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:36.469780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86ec46-e05e-4549-9845-f7f262883b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.469780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86ec46-e05e-4549-9845-f7f262883b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.469780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86ec46-e05e-4549-9845-f7f262883b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.469780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86ec46-e05e-4549-9845-f7f262883b5e admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.470896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86ec46-e05e-4549-9845-f7f262883b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.470981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a11b-9c7f-44da-ad46-1031b5addf98 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.472690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86ec46-e05e-4549-9845-f7f262883b5e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.480232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84a11b-9c7f-44da-ad46-1031b5addf98 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.485075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba91e0-d3ad-4ef2-b2ef-e2f1771755ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.486163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba91e0-d3ad-4ef2-b2ef-e2f1771755ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.486379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba91e0-d3ad-4ef2-b2ef-e2f1771755ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.486586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba91e0-d3ad-4ef2-b2ef-e2f1771755ee admin admin] PATH_INFO: `/v3/projects/5249a5166a574be7b004f9dd373f34c0/users/26770bd3d97d4cf98a3f8308f0e4068f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.488662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba91e0-d3ad-4ef2-b2ef-e2f1771755ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5249a5166a574be7b004f9dd373f34c0, user_id=26770bd3d97d4cf98a3f8308f0e4068f, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.491318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba91e0-d3ad-4ef2-b2ef-e2f1771755ee admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.497293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 956/1933] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:36 2022] POST /identity/v3/users => generated 281 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:39:36.501321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86ec46-e05e-4549-9845-f7f262883b5e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.503420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 978/1934] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:36 2022] PUT /identity/v3/projects/5249a5166a574be7b004f9dd373f34c0/users/26770bd3d97d4cf98a3f8308f0e4068f/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:39:36.513454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86ec46-e05e-4549-9845-f7f262883b5e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.514572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca5cb-70a0-480b-9b9d-dd5e520802fb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.514922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca5cb-70a0-480b-9b9d-dd5e520802fb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.515205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ca5cb-70a0-480b-9b9d-dd5e520802fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.542329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-9b5ca5cb-70a0-480b-9b9d-dd5e520802fb None None] MFA Rules not processed for user `26770bd3d97d4cf98a3f8308f0e4068f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:36.544711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9b5ca5cb-70a0-480b-9b9d-dd5e520802fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:36.590751 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec13c8-44a6-4b73-8bf9-c6d891f4bbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.591714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec13c8-44a6-4b73-8bf9-c6d891f4bbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.592008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec13c8-44a6-4b73-8bf9-c6d891f4bbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.592273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec13c8-44a6-4b73-8bf9-c6d891f4bbc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.593212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec13c8-44a6-4b73-8bf9-c6d891f4bbc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.595906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec13c8-44a6-4b73-8bf9-c6d891f4bbc8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.614069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 957/1935] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:36.615636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec13c8-44a6-4b73-8bf9-c6d891f4bbc8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.628173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec13c8-44a6-4b73-8bf9-c6d891f4bbc8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.634172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3d6a-465d-4edd-b521-5af5acaae3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.635431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3d6a-465d-4edd-b521-5af5acaae3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.635945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3d6a-465d-4edd-b521-5af5acaae3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.636506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3d6a-465d-4edd-b521-5af5acaae3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.636957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3d6a-465d-4edd-b521-5af5acaae3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.639253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3d6a-465d-4edd-b521-5af5acaae3e4 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.646635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 979/1936] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:36 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:36.659048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 958/1937] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:36.662515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ca5cb-70a0-480b-9b9d-dd5e520802fb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.663443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3d6a-465d-4edd-b521-5af5acaae3e4 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.664745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9b5ca5cb-70a0-480b-9b9d-dd5e520802fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:36.676554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3d6a-465d-4edd-b521-5af5acaae3e4 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.682198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b9bde-460a-4553-a38b-cdaa7cebe70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.683112 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9bde-460a-4553-a38b-cdaa7cebe70e admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.683399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9bde-460a-4553-a38b-cdaa7cebe70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.683681 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b9bde-460a-4553-a38b-cdaa7cebe70e admin admin] PATH_INFO: `/v3/projects/069b7d41dd51433f9732d511ac5ac51b/users/1788aaa1415f448c838e6817d5d1444d/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.701179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b9bde-460a-4553-a38b-cdaa7cebe70e admin admin] RBAC: Authorizing `identity:create_grant(project_id=069b7d41dd51433f9732d511ac5ac51b, user_id=1788aaa1415f448c838e6817d5d1444d, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.703570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:36.703734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b9bde-460a-4553-a38b-cdaa7cebe70e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.727604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 959/1938] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:36 2022] PUT /identity/v3/projects/069b7d41dd51433f9732d511ac5ac51b/users/1788aaa1415f448c838e6817d5d1444d/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:36.729304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac949-b577-49c2-bb29-13aedb2f8fd7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.729561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ca5cb-70a0-480b-9b9d-dd5e520802fb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.729680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac949-b577-49c2-bb29-13aedb2f8fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.729860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ac949-b577-49c2-bb29-13aedb2f8fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.759641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8c1ac949-b577-49c2-bb29-13aedb2f8fd7 None None] MFA Rules not processed for user `1788aaa1415f448c838e6817d5d1444d`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:36.761071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8c1ac949-b577-49c2-bb29-13aedb2f8fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:36.789885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5102cf7-d8e6-47ab-ac3f-c26ecea1205f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.790605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5102cf7-d8e6-47ab-ac3f-c26ecea1205f service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.791397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5102cf7-d8e6-47ab-ac3f-c26ecea1205f service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.792047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5102cf7-d8e6-47ab-ac3f-c26ecea1205f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.848049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 960/1939] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:36.875608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5102cf7-d8e6-47ab-ac3f-c26ecea1205f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.877062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5102cf7-d8e6-47ab-ac3f-c26ecea1205f service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.888473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 980/1940] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:36 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:39:36.891107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ac949-b577-49c2-bb29-13aedb2f8fd7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:36.892594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8c1ac949-b577-49c2-bb29-13aedb2f8fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:36.908077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ac949-b577-49c2-bb29-13aedb2f8fd7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:36.912440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ff81d-825d-41d0-8066-4c02eaf65818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:36.912966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ff81d-825d-41d0-8066-4c02eaf65818 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:36.913883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ff81d-825d-41d0-8066-4c02eaf65818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:36.914191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ff81d-825d-41d0-8066-4c02eaf65818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:36.924096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ff81d-825d-41d0-8066-4c02eaf65818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:36.925550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ff81d-825d-41d0-8066-4c02eaf65818 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:36.936063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 961/1941] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:39:36.951015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5102cf7-d8e6-47ab-ac3f-c26ecea1205f service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:37.023799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5102cf7-d8e6-47ab-ac3f-c26ecea1205f service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:37.028705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:37.029624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:37.029967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:37.030222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] PATH_INFO: `/v3/users/1788aaa1415f448c838e6817d5d1444d` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:37.031525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1788aaa1415f448c838e6817d5d1444d)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:37.033565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:37.087923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ff81d-825d-41d0-8066-4c02eaf65818 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:37.097080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:37.097675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ff81d-825d-41d0-8066-4c02eaf65818 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:37.102111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:37.103002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:37.103398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:37.103686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:37.104367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1788aaa1415f448c838e6817d5d1444d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:37.105891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:37.112896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:37.116123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1788aaa1415f448c838e6817d5d1444d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:37.117339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1788aaa1415f448c838e6817d5d1444d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:37.126677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1788aaa1415f448c838e6817d5d1444d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:37.140597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-eda5a0fb-7695-4542-87fa-8a4f4eab7cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1788aaa1415f448c838e6817d5d1444d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:37.147564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 981/1942] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:36 2022] DELETE /identity/v3/users/1788aaa1415f448c838e6817d5d1444d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:37.151804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54e90-6c09-47ad-9495-4cf92a95705c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:37.152098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54e90-6c09-47ad-9495-4cf92a95705c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:37.152382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54e90-6c09-47ad-9495-4cf92a95705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:37.175592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-bba54e90-6c09-47ad-9495-4cf92a95705c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:37.177428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bba54e90-6c09-47ad-9495-4cf92a95705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:37.188828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:37.190347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:37.200696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 962/1943] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:39:37.245730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 982/1944] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:37.255566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:37.256973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:37.311839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd236288-8d40-4039-86da-2a273b6f084b service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:37.376209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea1f2-f32a-4ae3-9178-a1372f1f27a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:37.377344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea1f2-f32a-4ae3-9178-a1372f1f27a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:37.377875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea1f2-f32a-4ae3-9178-a1372f1f27a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:37.378280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea1f2-f32a-4ae3-9178-a1372f1f27a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:37.392771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea1f2-f32a-4ae3-9178-a1372f1f27a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:37.394387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea1f2-f32a-4ae3-9178-a1372f1f27a0 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:37.408662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 963/1945] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:37.969333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba54e90-6c09-47ad-9495-4cf92a95705c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:37.971075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bba54e90-6c09-47ad-9495-4cf92a95705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:37.992730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba54e90-6c09-47ad-9495-4cf92a95705c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:37.999931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:37.999931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.000851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.001238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] PATH_INFO: `/v3/projects/069b7d41dd51433f9732d511ac5ac51b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.003879 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069b7d41dd51433f9732d511ac5ac51b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:38.006600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:38.082869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069b7d41dd51433f9732d511ac5ac51b', 'request_id': 'req-3cd61da4-41d3-465a-9cda-7524c901eb15'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:38.099581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069b7d41dd51433f9732d511ac5ac51b', 'request_id': 'req-3cd61da4-41d3-465a-9cda-7524c901eb15'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:38.110802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069b7d41dd51433f9732d511ac5ac51b', 'request_id': 'req-3cd61da4-41d3-465a-9cda-7524c901eb15'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:38.126646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] The token cache is being invalidate because project 069b7d41dd51433f9732d511ac5ac51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:38.126936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:38.127870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3cd61da4-41d3-465a-9cda-7524c901eb15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:38.129808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 983/1946] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:37 2022] DELETE /identity/v3/projects/069b7d41dd51433f9732d511ac5ac51b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:38.135272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a1ebf-6ce1-47a7-a868-2077ad1ebe06 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.135779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a1ebf-6ce1-47a7-a868-2077ad1ebe06 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.135982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a1ebf-6ce1-47a7-a868-2077ad1ebe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.162281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b53a1ebf-6ce1-47a7-a868-2077ad1ebe06 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:38.163513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b53a1ebf-6ce1-47a7-a868-2077ad1ebe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:38.266003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 964/1947] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:38.271160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076ef5f-cbf0-4327-a4f2-55de7ec2d49e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.271451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076ef5f-cbf0-4327-a4f2-55de7ec2d49e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.271732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076ef5f-cbf0-4327-a4f2-55de7ec2d49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.300646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-9076ef5f-cbf0-4327-a4f2-55de7ec2d49e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:38.301968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9076ef5f-cbf0-4327-a4f2-55de7ec2d49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:38.309840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 984/1948] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:38.314234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a1ebf-6ce1-47a7-a868-2077ad1ebe06 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:38.323991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a1ebf-6ce1-47a7-a868-2077ad1ebe06 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:38.328991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:38.329746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.330071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.330347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.331079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:39:38.331392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:38.332999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:38.334619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:38.346447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 965/1949] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:39:38.350892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076ef5f-cbf0-4327-a4f2-55de7ec2d49e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:38.360455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076ef5f-cbf0-4327-a4f2-55de7ec2d49e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:38.365290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b32d4-09d0-4e79-8c12-55d352c46ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:38.366156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b32d4-09d0-4e79-8c12-55d352c46ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.366425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b32d4-09d0-4e79-8c12-55d352c46ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.366706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b32d4-09d0-4e79-8c12-55d352c46ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.367454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b32d4-09d0-4e79-8c12-55d352c46ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:38.369394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b32d4-09d0-4e79-8c12-55d352c46ce8 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:38.396576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 985/1950] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:38 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:38.400600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:38.410649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0c068-b30a-4d05-a09a-b72ac227455f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:38.468856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aacb0-830c-492b-8ee3-3c20797cbb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:38.469540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aacb0-830c-492b-8ee3-3c20797cbb44 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.469856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aacb0-830c-492b-8ee3-3c20797cbb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.470179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8aacb0-830c-492b-8ee3-3c20797cbb44 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.470853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aacb0-830c-492b-8ee3-3c20797cbb44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:38.473300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8aacb0-830c-492b-8ee3-3c20797cbb44 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:38.499187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 966/1951] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:38 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:38.503586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b32d4-09d0-4e79-8c12-55d352c46ce8 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:38.514556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b32d4-09d0-4e79-8c12-55d352c46ce8 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:38.520016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5643c9-3bd4-4d7c-8930-9a0a7f73b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:38.520685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5643c9-3bd4-4d7c-8930-9a0a7f73b4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.520966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5643c9-3bd4-4d7c-8930-9a0a7f73b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.521244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5643c9-3bd4-4d7c-8930-9a0a7f73b4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.521992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5643c9-3bd4-4d7c-8930-9a0a7f73b4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:38.523664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5643c9-3bd4-4d7c-8930-9a0a7f73b4ef admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:38.537341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 986/1952] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:38.541709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aacb0-830c-492b-8ee3-3c20797cbb44 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:38.552490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8aacb0-830c-492b-8ee3-3c20797cbb44 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:38.557901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ee72c-f340-4390-a1a7-bb3215d047a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:38.558601 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee72c-f340-4390-a1a7-bb3215d047a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.558879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee72c-f340-4390-a1a7-bb3215d047a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.559147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ee72c-f340-4390-a1a7-bb3215d047a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.559880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ee72c-f340-4390-a1a7-bb3215d047a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:38.561494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ee72c-f340-4390-a1a7-bb3215d047a6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:38.571820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 967/1953] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:38.576432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5643c9-3bd4-4d7c-8930-9a0a7f73b4ef admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:38.583672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:38.591596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5643c9-3bd4-4d7c-8930-9a0a7f73b4ef admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:38.599328 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:38.600489 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.600819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.601203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] PATH_INFO: `/v3/projects/e89c3dc90f8946a88f461092e452711d/users/2ee64da1645e48879df4c7d75995ff6e/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.618016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89c3dc90f8946a88f461092e452711d, user_id=2ee64da1645e48879df4c7d75995ff6e, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:38.620703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:38.648677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 987/1954] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:38 2022] PUT /identity/v3/projects/e89c3dc90f8946a88f461092e452711d/users/2ee64da1645e48879df4c7d75995ff6e/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:38.659108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13fae4-9493-4a49-914e-164a25b94f6d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.659393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13fae4-9493-4a49-914e-164a25b94f6d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.659687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13fae4-9493-4a49-914e-164a25b94f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.688021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5a13fae4-9493-4a49-914e-164a25b94f6d None None] MFA Rules not processed for user `2ee64da1645e48879df4c7d75995ff6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:38.689319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5a13fae4-9493-4a49-914e-164a25b94f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:38.780653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 968/1955] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:39:38.793521 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:38.796112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:38.870093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb8f80-195f-49b9-98c2-cbdaaa4c7d37 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:38.873533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a5270-0bcf-47df-aced-73fadef84092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:38.874455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a5270-0bcf-47df-aced-73fadef84092 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:38.874641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a5270-0bcf-47df-aced-73fadef84092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:38.874936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a5270-0bcf-47df-aced-73fadef84092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:38.884318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a5270-0bcf-47df-aced-73fadef84092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:38.885866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a5270-0bcf-47df-aced-73fadef84092 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:38.897314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 988/1956] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:46.949982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13fae4-9493-4a49-914e-164a25b94f6d None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:46.952070 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5a13fae4-9493-4a49-914e-164a25b94f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:47.044411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13fae4-9493-4a49-914e-164a25b94f6d None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:47.052688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:47.053882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:47.054329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:47.054737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] PATH_INFO: `/v3/users/cd341e52843e43a7a33e0de223e32b0e` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:47.056338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd341e52843e43a7a33e0de223e32b0e)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:47.059062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:47.065325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:47.137704 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd341e52843e43a7a33e0de223e32b0e'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.138516 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd341e52843e43a7a33e0de223e32b0e'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.148540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd341e52843e43a7a33e0de223e32b0e'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.156849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd341e52843e43a7a33e0de223e32b0e'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.176801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd341e52843e43a7a33e0de223e32b0e'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.186787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 969/1957] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:46 2022] DELETE /identity/v3/users/cd341e52843e43a7a33e0de223e32b0e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:47.188570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b9bb-6d8a-4a4f-83f0-bf74c439de46 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:47.190614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b9bb-6d8a-4a4f-83f0-bf74c439de46 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:47.190614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108b9bb-6d8a-4a4f-83f0-bf74c439de46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:47.210710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2108b9bb-6d8a-4a4f-83f0-bf74c439de46 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:47.212014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2108b9bb-6d8a-4a4f-83f0-bf74c439de46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:47.279274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 989/1958] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:47.289676 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:47.291187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:47.361214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c4683-3f75-4786-951d-183e0ca39f2e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:47.365232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f485b83-06aa-4cdb-a2d0-fe49ff08b110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:47.365884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f485b83-06aa-4cdb-a2d0-fe49ff08b110 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:47.366187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f485b83-06aa-4cdb-a2d0-fe49ff08b110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:47.366513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f485b83-06aa-4cdb-a2d0-fe49ff08b110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:47.378157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f485b83-06aa-4cdb-a2d0-fe49ff08b110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:47.379622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f485b83-06aa-4cdb-a2d0-fe49ff08b110 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:47.389889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 970/1959] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:47.660817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108b9bb-6d8a-4a4f-83f0-bf74c439de46 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:47.662457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2108b9bb-6d8a-4a4f-83f0-bf74c439de46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:47.679611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108b9bb-6d8a-4a4f-83f0-bf74c439de46 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:47.685721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:47.686553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:47.686878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:47.687194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] PATH_INFO: `/v3/projects/9e63c1e8dd31498697cb1d027191af39` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:47.688533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e63c1e8dd31498697cb1d027191af39)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:47.690382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:47.741152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e63c1e8dd31498697cb1d027191af39', 'request_id': 'req-b91b85f7-1663-4980-a0fb-ebffabd0f757'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.752181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e63c1e8dd31498697cb1d027191af39', 'request_id': 'req-b91b85f7-1663-4980-a0fb-ebffabd0f757'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.759420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e63c1e8dd31498697cb1d027191af39', 'request_id': 'req-b91b85f7-1663-4980-a0fb-ebffabd0f757'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.773168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] The token cache is being invalidate because project 9e63c1e8dd31498697cb1d027191af39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:47.773463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.774315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.776029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 990/1960] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:47 2022] DELETE /identity/v3/projects/9e63c1e8dd31498697cb1d027191af39 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:47.780261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f485b83-06aa-4cdb-a2d0-fe49ff08b110 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:47.790256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f485b83-06aa-4cdb-a2d0-fe49ff08b110 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:47.847840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:47.848719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:47.848997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:47.849267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] PATH_INFO: `/v3/users/26770bd3d97d4cf98a3f8308f0e4068f` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:47.850465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26770bd3d97d4cf98a3f8308f0e4068f)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:47.852400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:47.882009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:47.904368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26770bd3d97d4cf98a3f8308f0e4068f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.905150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26770bd3d97d4cf98a3f8308f0e4068f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.914122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26770bd3d97d4cf98a3f8308f0e4068f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.921187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26770bd3d97d4cf98a3f8308f0e4068f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.933428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-62dcdd5e-59bc-449d-b5d9-f2f4d7c5172c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26770bd3d97d4cf98a3f8308f0e4068f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:47.939689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 971/1961] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:47 2022] DELETE /identity/v3/users/26770bd3d97d4cf98a3f8308f0e4068f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:48.276472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:48.278757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:48.298484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:48.303084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b85f7-1663-4980-a0fb-ebffabd0f757 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:48.419593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:48.420491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:48.420771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:48.421047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] PATH_INFO: `/v3/projects/5249a5166a574be7b004f9dd373f34c0` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:48.422487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5249a5166a574be7b004f9dd373f34c0)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:48.428692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:48.538027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5249a5166a574be7b004f9dd373f34c0', 'request_id': 'req-2177274b-5a0d-4319-b8b4-7d95c6568e86'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:48.551099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5249a5166a574be7b004f9dd373f34c0', 'request_id': 'req-2177274b-5a0d-4319-b8b4-7d95c6568e86'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:48.559519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5249a5166a574be7b004f9dd373f34c0', 'request_id': 'req-2177274b-5a0d-4319-b8b4-7d95c6568e86'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:48.578157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] The token cache is being invalidate because project 5249a5166a574be7b004f9dd373f34c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:48.579424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:48.582539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2177274b-5a0d-4319-b8b4-7d95c6568e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:48.586660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 991/1962] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:48 2022] DELETE /identity/v3/projects/5249a5166a574be7b004f9dd373f34c0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:48.589965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93354-5438-49e1-81be-a48d648cccca None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:48.590495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93354-5438-49e1-81be-a48d648cccca None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:48.590495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc93354-5438-49e1-81be-a48d648cccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:48.610902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1dc93354-5438-49e1-81be-a48d648cccca None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:48.612120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1dc93354-5438-49e1-81be-a48d648cccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:48.683342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 972/1963] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:48.685235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df534d-3239-474a-81b3-723de6912399 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:48.686055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df534d-3239-474a-81b3-723de6912399 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:48.686055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df534d-3239-474a-81b3-723de6912399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:48.723516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-28df534d-3239-474a-81b3-723de6912399 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:48.725196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-28df534d-3239-474a-81b3-723de6912399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:48.734776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 992/1964] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:48.739075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93354-5438-49e1-81be-a48d648cccca None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:48.754923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc93354-5438-49e1-81be-a48d648cccca None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:48.766480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:48.767358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:48.768531 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:48.770166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:48.771061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:39:48.771479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:48.774324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:48.794004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 973/1965] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:39:48.796749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df534d-3239-474a-81b3-723de6912399 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:48.816450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df534d-3239-474a-81b3-723de6912399 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:48.821966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96ac35-95b3-4c24-99e8-7417a7bf9193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:48.822883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ac35-95b3-4c24-99e8-7417a7bf9193 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:48.823237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ac35-95b3-4c24-99e8-7417a7bf9193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:48.824750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96ac35-95b3-4c24-99e8-7417a7bf9193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:48.825771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96ac35-95b3-4c24-99e8-7417a7bf9193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:48.828055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96ac35-95b3-4c24-99e8-7417a7bf9193 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:48.861053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 993/1966] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:48 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:48.865888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:48.877732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39c2e5-476a-46e3-b4b7-eb729b2ab33c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:48.946872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09bacb-cb3b-404b-928a-df9524924d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:48.947583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bacb-cb3b-404b-928a-df9524924d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:48.947862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bacb-cb3b-404b-928a-df9524924d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:48.948127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bacb-cb3b-404b-928a-df9524924d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:48.948821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09bacb-cb3b-404b-928a-df9524924d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:48.951155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09bacb-cb3b-404b-928a-df9524924d96 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:48.978337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 974/1967] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:48 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:48.979989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96ac35-95b3-4c24-99e8-7417a7bf9193 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:48.995670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96ac35-95b3-4c24-99e8-7417a7bf9193 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:49.003393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21adb2-21bb-40a5-9bf9-0a48a349e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:49.004889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21adb2-21bb-40a5-9bf9-0a48a349e384 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.005679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21adb2-21bb-40a5-9bf9-0a48a349e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.006571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21adb2-21bb-40a5-9bf9-0a48a349e384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.007762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21adb2-21bb-40a5-9bf9-0a48a349e384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:49.010830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21adb2-21bb-40a5-9bf9-0a48a349e384 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:49.030893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 994/1968] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:49.034975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09bacb-cb3b-404b-928a-df9524924d96 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:49.047701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09bacb-cb3b-404b-928a-df9524924d96 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:49.053201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2047471-4377-4449-b8d3-c17719cbaf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:49.054022 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047471-4377-4449-b8d3-c17719cbaf84 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.054356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047471-4377-4449-b8d3-c17719cbaf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.054716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2047471-4377-4449-b8d3-c17719cbaf84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.055486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2047471-4377-4449-b8d3-c17719cbaf84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:49.057160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2047471-4377-4449-b8d3-c17719cbaf84 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:49.069937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 975/1969] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:49.075506 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21adb2-21bb-40a5-9bf9-0a48a349e384 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:49.087698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21adb2-21bb-40a5-9bf9-0a48a349e384 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:49.095280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:49.096251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.096533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.096809 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] PATH_INFO: `/v3/projects/aab655dd130b4d36ae9308304f0c67ea/users/4955ebfc0c8a4e20b80165b4b83a9817/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.112732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab655dd130b4d36ae9308304f0c67ea, user_id=4955ebfc0c8a4e20b80165b4b83a9817, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:49.116179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:49.136700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 995/1970] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:49 2022] PUT /identity/v3/projects/aab655dd130b4d36ae9308304f0c67ea/users/4955ebfc0c8a4e20b80165b4b83a9817/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:49.147955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8652-d60e-4203-bfaf-54201cbdeca7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.148245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8652-d60e-4203-bfaf-54201cbdeca7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.148526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8652-d60e-4203-bfaf-54201cbdeca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.170506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:49.189445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-85cc8652-d60e-4203-bfaf-54201cbdeca7 None None] MFA Rules not processed for user `4955ebfc0c8a4e20b80165b4b83a9817`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:49.191479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-85cc8652-d60e-4203-bfaf-54201cbdeca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:49.274995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 976/1971] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:49.286589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:49.288893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:49.331508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:49.357417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca687e9-042f-46ce-8c72-9b1d987517ee admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:49.361175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530b71c-b5ae-49f9-b0bb-2f6de1f04b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:49.361955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b71c-b5ae-49f9-b0bb-2f6de1f04b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.362319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b71c-b5ae-49f9-b0bb-2f6de1f04b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.362670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530b71c-b5ae-49f9-b0bb-2f6de1f04b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.372492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530b71c-b5ae-49f9-b0bb-2f6de1f04b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:49.374747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530b71c-b5ae-49f9-b0bb-2f6de1f04b83 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:49.384683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 996/1972] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:39:49.404735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8652-d60e-4203-bfaf-54201cbdeca7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:49.467592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8652-d60e-4203-bfaf-54201cbdeca7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:49.472884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:49.473606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.473934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.474252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] PATH_INFO: `/v3/users/4955ebfc0c8a4e20b80165b4b83a9817` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.475485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4955ebfc0c8a4e20b80165b4b83a9817)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:49.477402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:49.527318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4955ebfc0c8a4e20b80165b4b83a9817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:49.528167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4955ebfc0c8a4e20b80165b4b83a9817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:49.537817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4955ebfc0c8a4e20b80165b4b83a9817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:49.545493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4955ebfc0c8a4e20b80165b4b83a9817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:49.560461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4955ebfc0c8a4e20b80165b4b83a9817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:49.567127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 977/1973] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:39:49 2022] DELETE /identity/v3/users/4955ebfc0c8a4e20b80165b4b83a9817 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:49.571692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1d8e2-bc74-48c1-92df-bdefba6f1ef3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.571979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1d8e2-bc74-48c1-92df-bdefba6f1ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.572259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1d8e2-bc74-48c1-92df-bdefba6f1ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.591293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-cca1d8e2-bc74-48c1-92df-bdefba6f1ef3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:49.592510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cca1d8e2-bc74-48c1-92df-bdefba6f1ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:49.659983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 997/1974] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:49.669647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:49.671111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:49.690644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:49.732663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064038d5-74e4-49fe-be21-6fffe156f7d5 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:49.736353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045c9c1-a6c3-4230-86f6-ca8acd72f03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:49.737012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c9c1-a6c3-4230-86f6-ca8acd72f03d service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:49.737293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c9c1-a6c3-4230-86f6-ca8acd72f03d service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:49.737567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045c9c1-a6c3-4230-86f6-ca8acd72f03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:49.750158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045c9c1-a6c3-4230-86f6-ca8acd72f03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:49.751756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045c9c1-a6c3-4230-86f6-ca8acd72f03d service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:49.763738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 978/1975] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:39:50.264278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1d8e2-bc74-48c1-92df-bdefba6f1ef3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:50.265765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cca1d8e2-bc74-48c1-92df-bdefba6f1ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:50.295332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1d8e2-bc74-48c1-92df-bdefba6f1ef3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:50.302374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:50.303476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.303614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.304056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] PATH_INFO: `/v3/projects/aab655dd130b4d36ae9308304f0c67ea` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.311289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab655dd130b4d36ae9308304f0c67ea)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:50.314649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:50.377914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab655dd130b4d36ae9308304f0c67ea', 'request_id': 'req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:50.388715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab655dd130b4d36ae9308304f0c67ea', 'request_id': 'req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:50.394799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab655dd130b4d36ae9308304f0c67ea', 'request_id': 'req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:50.407700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] The token cache is being invalidate because project aab655dd130b4d36ae9308304f0c67ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:39:50.408087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:50.408743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a91b73ea-d068-4fd8-85e9-27b9a8bceaef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:39:50.410463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 998/1976] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:39:50 2022] DELETE /identity/v3/projects/aab655dd130b4d36ae9308304f0c67ea => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:50.415532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe3e6-e226-4d6d-8655-2e1d4531541f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.415823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe3e6-e226-4d6d-8655-2e1d4531541f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.416104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1fe3e6-e226-4d6d-8655-2e1d4531541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.433754 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bd1fe3e6-e226-4d6d-8655-2e1d4531541f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:50.435046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bd1fe3e6-e226-4d6d-8655-2e1d4531541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:50.521922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 979/1977] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:50.531440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4700-1809-406d-9041-5cc9eab403fd None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.532002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4700-1809-406d-9041-5cc9eab403fd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.532310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e4700-1809-406d-9041-5cc9eab403fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.568274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-184e4700-1809-406d-9041-5cc9eab403fd None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:50.571829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-184e4700-1809-406d-9041-5cc9eab403fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:50.585805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 999/1978] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:50.587602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe3e6-e226-4d6d-8655-2e1d4531541f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:50.601115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1fe3e6-e226-4d6d-8655-2e1d4531541f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:50.607049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:50.608555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.609081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.609556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.610541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:39:50.611022 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:50.612916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:50.627232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 980/1979] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:39:50.631568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e4700-1809-406d-9041-5cc9eab403fd None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:50.641537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e4700-1809-406d-9041-5cc9eab403fd None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:50.647003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7f301-57fe-42f5-9a48-5f5787fef707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:50.647353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f301-57fe-42f5-9a48-5f5787fef707 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.647872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f301-57fe-42f5-9a48-5f5787fef707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.648176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7f301-57fe-42f5-9a48-5f5787fef707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.648857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7f301-57fe-42f5-9a48-5f5787fef707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:50.651188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7f301-57fe-42f5-9a48-5f5787fef707 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:50.686013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1000/1980] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:39:50 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:39:50.691294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:50.706257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f376f07-81a9-48dd-a1d3-eca820cbca18 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:50.774414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea315911-c56d-45bc-b11c-acf7f46e3713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:50.775356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315911-c56d-45bc-b11c-acf7f46e3713 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.775929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315911-c56d-45bc-b11c-acf7f46e3713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.776318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea315911-c56d-45bc-b11c-acf7f46e3713 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.777858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea315911-c56d-45bc-b11c-acf7f46e3713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:50.780287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea315911-c56d-45bc-b11c-acf7f46e3713 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:50.820274 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 981/1981] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:39:50 2022] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:39:50.826389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7f301-57fe-42f5-9a48-5f5787fef707 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:50.840465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7f301-57fe-42f5-9a48-5f5787fef707 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:50.848501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d017f-565f-4d12-a7b9-e7a859c12cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:50.849437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d017f-565f-4d12-a7b9-e7a859c12cad admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.849750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d017f-565f-4d12-a7b9-e7a859c12cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.850187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d017f-565f-4d12-a7b9-e7a859c12cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.850962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d017f-565f-4d12-a7b9-e7a859c12cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:50.852794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d017f-565f-4d12-a7b9-e7a859c12cad admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:50.871806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1001/1982] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:39:50.873615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea315911-c56d-45bc-b11c-acf7f46e3713 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:50.889115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea315911-c56d-45bc-b11c-acf7f46e3713 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:50.894759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe188a-1630-459b-b201-c4b717f6e931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:50.895460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe188a-1630-459b-b201-c4b717f6e931 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.895744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe188a-1630-459b-b201-c4b717f6e931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.896031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe188a-1630-459b-b201-c4b717f6e931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.896892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe188a-1630-459b-b201-c4b717f6e931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:50.898574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe188a-1630-459b-b201-c4b717f6e931 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:50.920149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 982/1983] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:39:50.921115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d017f-565f-4d12-a7b9-e7a859c12cad admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:50.932160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d017f-565f-4d12-a7b9-e7a859c12cad admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:50.941765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:50.944276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:50.945241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:50.947736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] PATH_INFO: `/v3/projects/96c45c8ac3fe40bdb685180ded10926a/users/62bfc800c9994b6187ad73fdf8bda739/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:50.994014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c45c8ac3fe40bdb685180ded10926a, user_id=62bfc800c9994b6187ad73fdf8bda739, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:51.000288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:51.004832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:51.031983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1002/1984] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:39:50 2022] PUT /identity/v3/projects/96c45c8ac3fe40bdb685180ded10926a/users/62bfc800c9994b6187ad73fdf8bda739/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:39:51.043429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e5f4-adeb-4b02-bc97-7bb74c70898d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:51.044385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e5f4-adeb-4b02-bc97-7bb74c70898d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:51.044667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9e5f4-adeb-4b02-bc97-7bb74c70898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:51.103005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-25a9e5f4-adeb-4b02-bc97-7bb74c70898d None None] MFA Rules not processed for user `62bfc800c9994b6187ad73fdf8bda739`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:39:51.113786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-25a9e5f4-adeb-4b02-bc97-7bb74c70898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:51.140213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:39:51.216647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 983/1985] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:39:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:39:51.224654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:39:51.228240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:39:51.312059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338173d-b610-4eb0-b8bd-ba00fcd5a437 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:39:51.317838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1a1889e2fb436a86c5e68bf9f1e608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:39:51.318644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:39:51.318894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:39:51.319117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:39:51.338227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:39:51.339738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:39:51.350224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1003/1986] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:39:51 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:40:01.208732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=20 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:01.346016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:40:32.934157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ba606-d368-4b1c-905a-d028f0a1020f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:40:32.934795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ba606-d368-4b1c-905a-d028f0a1020f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:40:32.934795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ba606-d368-4b1c-905a-d028f0a1020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:40:32.962449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-6c9ba606-d368-4b1c-905a-d028f0a1020f None None] MFA Rules not processed for user `c8d8523e71264696997f23122115687a`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:40:32.963674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6c9ba606-d368-4b1c-905a-d028f0a1020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:40:33.043910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 984/1987] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:40:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:40:43.041419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=37 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:03.367268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:03.369003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:03.535916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6425f-5dba-40c4-8347-93965aeb3b0c service glance] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:03.547155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:03.548095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:03.548376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:03.548655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] PATH_INFO: `/v3/users/2ee64da1645e48879df4c7d75995ff6e` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:03.550082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee64da1645e48879df4c7d75995ff6e)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:03.552145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:03.602427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee64da1645e48879df4c7d75995ff6e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:03.610935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee64da1645e48879df4c7d75995ff6e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:03.611565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee64da1645e48879df4c7d75995ff6e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:03.619228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee64da1645e48879df4c7d75995ff6e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:03.631281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee64da1645e48879df4c7d75995ff6e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:03.637462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1004/1988] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:03 2022] DELETE /identity/v3/users/2ee64da1645e48879df4c7d75995ff6e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:03.642238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8e608-c8d2-43f9-90ae-239f343d241e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:03.642755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8e608-c8d2-43f9-90ae-239f343d241e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:03.642835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8e608-c8d2-43f9-90ae-239f343d241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:03.672630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b5e8e608-c8d2-43f9-90ae-239f343d241e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:03.674032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b5e8e608-c8d2-43f9-90ae-239f343d241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:03.751727 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 985/1989] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:03.761360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:03.762985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:03.798603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:03.908322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5ffb1-b36c-41d9-8c9a-851525145dfe admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:03.913486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a431a2-a429-466f-bb3d-3839e2d42a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:03.914039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a431a2-a429-466f-bb3d-3839e2d42a00 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:03.914486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a431a2-a429-466f-bb3d-3839e2d42a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:03.914775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a431a2-a429-466f-bb3d-3839e2d42a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:03.927977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a431a2-a429-466f-bb3d-3839e2d42a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:03.930073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a431a2-a429-466f-bb3d-3839e2d42a00 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:03.944205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1005/1990] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:41:04.364827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8e608-c8d2-43f9-90ae-239f343d241e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:04.366480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b5e8e608-c8d2-43f9-90ae-239f343d241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:04.380184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e8e608-c8d2-43f9-90ae-239f343d241e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:04.387238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:04.393569 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:04.393853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:04.394210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] PATH_INFO: `/v3/projects/e89c3dc90f8946a88f461092e452711d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:04.395647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89c3dc90f8946a88f461092e452711d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:04.397742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:04.456815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89c3dc90f8946a88f461092e452711d', 'request_id': 'req-298fecef-cc08-4c4d-95e6-ec1c36822a6a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.467391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89c3dc90f8946a88f461092e452711d', 'request_id': 'req-298fecef-cc08-4c4d-95e6-ec1c36822a6a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.476327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89c3dc90f8946a88f461092e452711d', 'request_id': 'req-298fecef-cc08-4c4d-95e6-ec1c36822a6a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.494523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] The token cache is being invalidate because project e89c3dc90f8946a88f461092e452711d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:04.494872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.495831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-298fecef-cc08-4c4d-95e6-ec1c36822a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.498104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 986/1991] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:04 2022] DELETE /identity/v3/projects/e89c3dc90f8946a88f461092e452711d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:04.502711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890fe53-7063-4fa2-8688-6bd0f6573e3b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:04.503206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890fe53-7063-4fa2-8688-6bd0f6573e3b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:04.503292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890fe53-7063-4fa2-8688-6bd0f6573e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:04.574423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-7890fe53-7063-4fa2-8688-6bd0f6573e3b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:04.575854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7890fe53-7063-4fa2-8688-6bd0f6573e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:04.580523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb5b9-410a-4e7d-aad5-864dbefd2073 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:04.580809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb5b9-410a-4e7d-aad5-864dbefd2073 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:04.581083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbb5b9-410a-4e7d-aad5-864dbefd2073 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:04.582974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 987/1992] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:41:04.629876 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8f13-b572-44ad-855d-4a6ce2728086 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:04.630327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8f13-b572-44ad-855d-4a6ce2728086 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:04.630716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b8f13-b572-44ad-855d-4a6ce2728086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:04.687150 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1006/1993] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:04.688154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890fe53-7063-4fa2-8688-6bd0f6573e3b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:04.689492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7890fe53-7063-4fa2-8688-6bd0f6573e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:04.705478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890fe53-7063-4fa2-8688-6bd0f6573e3b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:04.711768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b93b8f13-b572-44ad-855d-4a6ce2728086 None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:04.713258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b93b8f13-b572-44ad-855d-4a6ce2728086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:04.714987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:04.715849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:04.716262 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:04.716560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] PATH_INFO: `/v3/users/0b4c1e464c194939ac4ead76af5440fe` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:04.717989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4c1e464c194939ac4ead76af5440fe)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:04.721184 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:04.760677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:04.810851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4c1e464c194939ac4ead76af5440fe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.819447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 988/1994] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:41:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:04.822917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4c1e464c194939ac4ead76af5440fe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.824491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4c1e464c194939ac4ead76af5440fe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.832091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf96c7-ed09-4b74-a50e-dffaa4603d97 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:04.832391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf96c7-ed09-4b74-a50e-dffaa4603d97 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:04.832680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf96c7-ed09-4b74-a50e-dffaa4603d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:04.836755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4c1e464c194939ac4ead76af5440fe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.839774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:04.851721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-cabf96c7-ed09-4b74-a50e-dffaa4603d97 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:04.852964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cabf96c7-ed09-4b74-a50e-dffaa4603d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:04.855178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4c1e464c194939ac4ead76af5440fe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:04.864642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 989/1995] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:04.864642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf96c7-ed09-4b74-a50e-dffaa4603d97 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:04.864642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cabf96c7-ed09-4b74-a50e-dffaa4603d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:04.866702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1007/1996] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:04 2022] DELETE /identity/v3/users/0b4c1e464c194939ac4ead76af5440fe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:04.867670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:04.883689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf96c7-ed09-4b74-a50e-dffaa4603d97 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:04.965215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:04.965705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:04.966020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:04.966305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:04.968464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:04.983900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:04.985976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:04.997162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1bf39-809b-42c0-ae4e-c7404e909c7b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:04.999815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 990/1997] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:05.014152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.015157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.015442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.015865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.016505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:05.016817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.018692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.034210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1008/1998] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:05.038749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.069650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b31ac-f28d-4770-98d6-0abcf06eb234 service placement] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.079862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1ebf8-5249-400d-89cd-c93af4ed52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.082308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ebf8-5249-400d-89cd-c93af4ed52bb admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.082765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ebf8-5249-400d-89cd-c93af4ed52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.083349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1ebf8-5249-400d-89cd-c93af4ed52bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.085327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1ebf8-5249-400d-89cd-c93af4ed52bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.087796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1ebf8-5249-400d-89cd-c93af4ed52bb admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.099412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.101482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.141574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 991/1999] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:05 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:05.142629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1ebf8-5249-400d-89cd-c93af4ed52bb admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.149828 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7ee66-362d-4740-a74b-c67742c975dc admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.224872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1ebf8-5249-400d-89cd-c93af4ed52bb admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.227121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.228006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.228290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.228570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] PATH_INFO: `/v3/projects/66ecca1332d04a0faf9ccbb60f958e22` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.229754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ecca1332d04a0faf9ccbb60f958e22)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.230068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.231011 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.231330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.231579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.231844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.237417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.240066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.267205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 992/2000] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:05 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:05.268097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.270672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.284814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0e64-e219-4093-bdf2-6df1ec80f228 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.290754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ecca1332d04a0faf9ccbb60f958e22', 'request_id': 'req-4e586309-d73f-454a-9a96-7fa12ce1c709'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.300583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ecca1332d04a0faf9ccbb60f958e22', 'request_id': 'req-4e586309-d73f-454a-9a96-7fa12ce1c709'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.307603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:05.309104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ecca1332d04a0faf9ccbb60f958e22', 'request_id': 'req-4e586309-d73f-454a-9a96-7fa12ce1c709'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.326340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] The token cache is being invalidate because project 66ecca1332d04a0faf9ccbb60f958e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:05.326745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.327536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.335416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1009/2001] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:05 2022] DELETE /identity/v3/projects/66ecca1332d04a0faf9ccbb60f958e22 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:05.335416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.336538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.353067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:05.366358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.367413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.367703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.367978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] PATH_INFO: `/v3/users/62bfc800c9994b6187ad73fdf8bda739` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.369241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62bfc800c9994b6187ad73fdf8bda739)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.371306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.424720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e586309-d73f-454a-9a96-7fa12ce1c709 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.430583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07592880-9460-48ea-a944-e8780300b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.431167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07592880-9460-48ea-a944-e8780300b719 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.431453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07592880-9460-48ea-a944-e8780300b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.431731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07592880-9460-48ea-a944-e8780300b719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.432481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07592880-9460-48ea-a944-e8780300b719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.434255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07592880-9460-48ea-a944-e8780300b719 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.437562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62bfc800c9994b6187ad73fdf8bda739'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.438264 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62bfc800c9994b6187ad73fdf8bda739'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.445917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1010/2002] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:05.449383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efecc-6a8d-43af-9fa9-a51f9e93bb45 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.449383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efecc-6a8d-43af-9fa9-a51f9e93bb45 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.449383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efecc-6a8d-43af-9fa9-a51f9e93bb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.449667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62bfc800c9994b6187ad73fdf8bda739'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.458258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62bfc800c9994b6187ad73fdf8bda739'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.469086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-222efecc-6a8d-43af-9fa9-a51f9e93bb45 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:05.470458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-222efecc-6a8d-43af-9fa9-a51f9e93bb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.470791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62bfc800c9994b6187ad73fdf8bda739'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:05.478399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 993/2003] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:05 2022] DELETE /identity/v3/users/62bfc800c9994b6187ad73fdf8bda739 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:05.479224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1011/2004] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:05.479446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.480846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.482940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6a4bd-bd11-4cbb-8345-67be959769e8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.483439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6a4bd-bd11-4cbb-8345-67be959769e8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.483865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6a4bd-bd11-4cbb-8345-67be959769e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.502963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2dd6a4bd-bd11-4cbb-8345-67be959769e8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:05.504156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2dd6a4bd-bd11-4cbb-8345-67be959769e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.551498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c3f7d-b7fa-4a98-a126-57691a767d42 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.556174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d62e-c87f-4d56-8368-935516ce86c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.556846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d62e-c87f-4d56-8368-935516ce86c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.557129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d62e-c87f-4d56-8368-935516ce86c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.557405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4d62e-c87f-4d56-8368-935516ce86c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.558172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d62e-c87f-4d56-8368-935516ce86c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.559784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4d62e-c87f-4d56-8368-935516ce86c9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.564552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1012/2005] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:05.567361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff12f9-4e95-4592-9f4f-a716aa0bc4b6 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.567700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff12f9-4e95-4592-9f4f-a716aa0bc4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.567985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff12f9-4e95-4592-9f4f-a716aa0bc4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.570234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 994/2006] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:05.574557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d62e-c87f-4d56-8368-935516ce86c9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.584955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4d62e-c87f-4d56-8368-935516ce86c9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.587110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-33ff12f9-4e95-4592-9f4f-a716aa0bc4b6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:05.588341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-33ff12f9-4e95-4592-9f4f-a716aa0bc4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.589687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa1b8-c8bd-4714-a9d3-e0313957c8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.590607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa1b8-c8bd-4714-a9d3-e0313957c8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.591004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa1b8-c8bd-4714-a9d3-e0313957c8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.591285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfa1b8-c8bd-4714-a9d3-e0313957c8c7 admin admin] PATH_INFO: `/v3/projects/3c246c3836864d4ba0f52adcd0d3f194/users/bce416bb3c38461abc8d89b59a09b9cb/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.597068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1013/2007] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:05.597977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff12f9-4e95-4592-9f4f-a716aa0bc4b6 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.599412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-33ff12f9-4e95-4592-9f4f-a716aa0bc4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.607598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfa1b8-c8bd-4714-a9d3-e0313957c8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c246c3836864d4ba0f52adcd0d3f194, user_id=bce416bb3c38461abc8d89b59a09b9cb, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.610289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfa1b8-c8bd-4714-a9d3-e0313957c8c7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.624130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 995/2008] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:05 2022] PUT /identity/v3/projects/3c246c3836864d4ba0f52adcd0d3f194/users/bce416bb3c38461abc8d89b59a09b9cb/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:05.625102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa1b8-c8bd-4714-a9d3-e0313957c8c7 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.639104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:05.658608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff12f9-4e95-4592-9f4f-a716aa0bc4b6 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.689987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfa1b8-c8bd-4714-a9d3-e0313957c8c7 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.694811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eb7c2-ebdc-45ec-b441-f9cab278b534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.695528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb7c2-ebdc-45ec-b441-f9cab278b534 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.695956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb7c2-ebdc-45ec-b441-f9cab278b534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.696210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb7c2-ebdc-45ec-b441-f9cab278b534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.696936 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb7c2-ebdc-45ec-b441-f9cab278b534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:05.697240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb7c2-ebdc-45ec-b441-f9cab278b534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.699326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb7c2-ebdc-45ec-b441-f9cab278b534 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.702449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:05.708689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2129-0a49-4cd6-bfcb-c8f30e7c5b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.709873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2129-0a49-4cd6-bfcb-c8f30e7c5b92 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.710384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2129-0a49-4cd6-bfcb-c8f30e7c5b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.710660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d2129-0a49-4cd6-bfcb-c8f30e7c5b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.712811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 996/2009] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:05.714105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059086f-2e50-4ad4-a012-d6018f1e7774 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.714382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059086f-2e50-4ad4-a012-d6018f1e7774 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.714668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059086f-2e50-4ad4-a012-d6018f1e7774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.722161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d2129-0a49-4cd6-bfcb-c8f30e7c5b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.723664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d2129-0a49-4cd6-bfcb-c8f30e7c5b92 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.733300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1014/2010] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:05.733905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2129-0a49-4cd6-bfcb-c8f30e7c5b92 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.742801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3059086f-2e50-4ad4-a012-d6018f1e7774 None None] MFA Rules not processed for user `bce416bb3c38461abc8d89b59a09b9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:05.743513 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d2129-0a49-4cd6-bfcb-c8f30e7c5b92 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.744284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3059086f-2e50-4ad4-a012-d6018f1e7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.748665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586879e0-51c7-4321-aaab-50ff1b12f2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.749312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586879e0-51c7-4321-aaab-50ff1b12f2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.749867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586879e0-51c7-4321-aaab-50ff1b12f2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.749867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586879e0-51c7-4321-aaab-50ff1b12f2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.750570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586879e0-51c7-4321-aaab-50ff1b12f2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.752516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586879e0-51c7-4321-aaab-50ff1b12f2e9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.781031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1015/2011] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:05 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:05.785347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586879e0-51c7-4321-aaab-50ff1b12f2e9 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.822696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 997/2012] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:05.836284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059086f-2e50-4ad4-a012-d6018f1e7774 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.837782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3059086f-2e50-4ad4-a012-d6018f1e7774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:05.861207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586879e0-51c7-4321-aaab-50ff1b12f2e9 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.866734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c77f23-d743-4484-a785-de6486c45b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.867595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77f23-d743-4484-a785-de6486c45b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.867885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77f23-d743-4484-a785-de6486c45b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.868169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c77f23-d743-4484-a785-de6486c45b9c admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.869010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c77f23-d743-4484-a785-de6486c45b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.871338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c77f23-d743-4484-a785-de6486c45b9c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.910617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1016/2013] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:05 2022] POST /identity/v3/users => generated 283 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:05.915005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c77f23-d743-4484-a785-de6486c45b9c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.925481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c77f23-d743-4484-a785-de6486c45b9c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.930523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502df60-9292-4dab-b0b0-ecadaf7ff6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.931319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502df60-9292-4dab-b0b0-ecadaf7ff6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.932127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502df60-9292-4dab-b0b0-ecadaf7ff6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.932127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502df60-9292-4dab-b0b0-ecadaf7ff6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.932872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502df60-9292-4dab-b0b0-ecadaf7ff6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.934644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502df60-9292-4dab-b0b0-ecadaf7ff6ef admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.942313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059086f-2e50-4ad4-a012-d6018f1e7774 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.945571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1017/2014] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:05.949851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502df60-9292-4dab-b0b0-ecadaf7ff6ef admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.960431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502df60-9292-4dab-b0b0-ecadaf7ff6ef admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.965144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280e0aa-b7fd-47d4-a567-db1d6b654f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:05.965815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e0aa-b7fd-47d4-a567-db1d6b654f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:05.966128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e0aa-b7fd-47d4-a567-db1d6b654f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:05.966406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e0aa-b7fd-47d4-a567-db1d6b654f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:05.967137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280e0aa-b7fd-47d4-a567-db1d6b654f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:05.968745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280e0aa-b7fd-47d4-a567-db1d6b654f87 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:05.979807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1018/2015] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:05.983486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:05.983883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280e0aa-b7fd-47d4-a567-db1d6b654f87 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:05.994502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280e0aa-b7fd-47d4-a567-db1d6b654f87 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:05.999364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:06.001029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:06.001370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:06.001746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] PATH_INFO: `/v3/projects/701cbc222601443c8fc3205bb11a046b/users/3e6bb3c13e6e4304bc7db5e7edb6929d/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:06.004030 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304ed7e-5684-4427-8782-346acecb94ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:06.004725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ed7e-5684-4427-8782-346acecb94ab service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:06.006786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ed7e-5684-4427-8782-346acecb94ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:06.007215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304ed7e-5684-4427-8782-346acecb94ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:06.028588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701cbc222601443c8fc3205bb11a046b, user_id=3e6bb3c13e6e4304bc7db5e7edb6929d, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:06.031356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:06.050515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1019/2016] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:05 2022] PUT /identity/v3/projects/701cbc222601443c8fc3205bb11a046b/users/3e6bb3c13e6e4304bc7db5e7edb6929d/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:06.051512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:06.062813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:06.095664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304ed7e-5684-4427-8782-346acecb94ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:06.097140 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304ed7e-5684-4427-8782-346acecb94ab service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:06.106939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 998/2017] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:41:06.111788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9759-100a-408e-8a0c-600e7e555f99 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:06.112153 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9759-100a-408e-8a0c-600e7e555f99 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:06.112438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a9759-100a-408e-8a0c-600e7e555f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:06.144578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba003c-13bc-4f65-9960-8d14890f5c70 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:06.148610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-282a9759-100a-408e-8a0c-600e7e555f99 None None] MFA Rules not processed for user `3e6bb3c13e6e4304bc7db5e7edb6929d`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:06.150008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-282a9759-100a-408e-8a0c-600e7e555f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:06.150470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:06.151583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:06.151941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:06.152288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] PATH_INFO: `/v3/projects/96c45c8ac3fe40bdb685180ded10926a` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:06.153598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c45c8ac3fe40bdb685180ded10926a)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:06.155650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:06.168790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:06.213056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c45c8ac3fe40bdb685180ded10926a', 'request_id': 'req-4e2a930e-e515-47ba-a22f-de0cdfda3891'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.224258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 999/2018] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:06.225262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a9759-100a-408e-8a0c-600e7e555f99 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:06.228006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c45c8ac3fe40bdb685180ded10926a', 'request_id': 'req-4e2a930e-e515-47ba-a22f-de0cdfda3891'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.236925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a9759-100a-408e-8a0c-600e7e555f99 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:06.238017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c45c8ac3fe40bdb685180ded10926a', 'request_id': 'req-4e2a930e-e515-47ba-a22f-de0cdfda3891'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.250768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] The token cache is being invalidate because project 96c45c8ac3fe40bdb685180ded10926a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:06.251195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.252018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.253692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1020/2019] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:06 2022] DELETE /identity/v3/projects/96c45c8ac3fe40bdb685180ded10926a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:06.254550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:06.255939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:06.320918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:06.322141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:06.322577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:06.323034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] PATH_INFO: `/v3/users/bce416bb3c38461abc8d89b59a09b9cb` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:06.324920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce416bb3c38461abc8d89b59a09b9cb)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:06.327154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:06.338704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a930e-e515-47ba-a22f-de0cdfda3891 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:06.343211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89226c6-94bc-4c7a-bbe9-fc8d8e99289d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:06.343886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89226c6-94bc-4c7a-bbe9-fc8d8e99289d service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:06.344168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89226c6-94bc-4c7a-bbe9-fc8d8e99289d service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:06.344442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89226c6-94bc-4c7a-bbe9-fc8d8e99289d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:06.346309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f89226c6-94bc-4c7a-bbe9-fc8d8e99289d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:06.353352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:06.391692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce416bb3c38461abc8d89b59a09b9cb'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.392533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce416bb3c38461abc8d89b59a09b9cb'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.406267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce416bb3c38461abc8d89b59a09b9cb'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.417039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce416bb3c38461abc8d89b59a09b9cb'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.427683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89226c6-94bc-4c7a-bbe9-fc8d8e99289d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:06.429424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89226c6-94bc-4c7a-bbe9-fc8d8e99289d service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:06.434435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce416bb3c38461abc8d89b59a09b9cb'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:06.440827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1021/2020] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:06.442556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1000/2021] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:06 2022] DELETE /identity/v3/users/bce416bb3c38461abc8d89b59a09b9cb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:06.447565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8086-f26a-4c7e-828b-c17cd78aed60 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:06.447864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8086-f26a-4c7e-828b-c17cd78aed60 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:06.448149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8086-f26a-4c7e-828b-c17cd78aed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:06.471112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-216e8086-f26a-4c7e-828b-c17cd78aed60 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:06.472551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-216e8086-f26a-4c7e-828b-c17cd78aed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:06.522410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:06.536847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1022/2022] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:06.546727 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:06.548187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:06.611944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3fd59-0f41-4ce7-881f-39901c8991c2 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:06.615581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b985f-375e-4378-9c04-d60fc3c34a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:06.616229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b985f-375e-4378-9c04-d60fc3c34a97 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:06.616532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b985f-375e-4378-9c04-d60fc3c34a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:06.616804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b985f-375e-4378-9c04-d60fc3c34a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:06.626309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b985f-375e-4378-9c04-d60fc3c34a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:06.627746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b985f-375e-4378-9c04-d60fc3c34a97 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:06.637745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1001/2023] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:06.977872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8086-f26a-4c7e-828b-c17cd78aed60 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:06.979546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-216e8086-f26a-4c7e-828b-c17cd78aed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:06.994380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8086-f26a-4c7e-828b-c17cd78aed60 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:07.000345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:07.001480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.001769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.002175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] PATH_INFO: `/v3/projects/3c246c3836864d4ba0f52adcd0d3f194` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.003577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c246c3836864d4ba0f52adcd0d3f194)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:07.007037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:07.059575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c246c3836864d4ba0f52adcd0d3f194', 'request_id': 'req-0beabc36-7494-410e-a927-90682d3364f0'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:07.070656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c246c3836864d4ba0f52adcd0d3f194', 'request_id': 'req-0beabc36-7494-410e-a927-90682d3364f0'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:07.078345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c246c3836864d4ba0f52adcd0d3f194', 'request_id': 'req-0beabc36-7494-410e-a927-90682d3364f0'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:07.090061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] The token cache is being invalidate because project 3c246c3836864d4ba0f52adcd0d3f194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:07.090355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:07.091154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0beabc36-7494-410e-a927-90682d3364f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:07.092886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1023/2024] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:06 2022] DELETE /identity/v3/projects/3c246c3836864d4ba0f52adcd0d3f194 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:07.098248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3635-cc09-408e-8334-88bf7e427560 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.098812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3635-cc09-408e-8334-88bf7e427560 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.098812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e3635-cc09-408e-8334-88bf7e427560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.118647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8f7e3635-cc09-408e-8334-88bf7e427560 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:07.119871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8f7e3635-cc09-408e-8334-88bf7e427560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:07.185435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1002/2025] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:07.194455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72afa-5897-486b-aab6-bec9cd466353 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.194455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72afa-5897-486b-aab6-bec9cd466353 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.194762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72afa-5897-486b-aab6-bec9cd466353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.214481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e7b72afa-5897-486b-aab6-bec9cd466353 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:07.215723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e7b72afa-5897-486b-aab6-bec9cd466353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:07.225717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1024/2026] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:07.230023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e3635-cc09-408e-8334-88bf7e427560 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:07.239875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e3635-cc09-408e-8334-88bf7e427560 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:07.245383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:07.246073 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.246352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.246624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.247351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:07.247653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:07.249253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:07.261753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1003/2027] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:41:07.266363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b72afa-5897-486b-aab6-bec9cd466353 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:07.276343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b72afa-5897-486b-aab6-bec9cd466353 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:07.282189 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda67f0-676d-46fb-ae23-136fb9d7a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:07.282852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda67f0-676d-46fb-ae23-136fb9d7a67d admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.283163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda67f0-676d-46fb-ae23-136fb9d7a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.283432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda67f0-676d-46fb-ae23-136fb9d7a67d admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.284134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda67f0-676d-46fb-ae23-136fb9d7a67d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:07.286125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda67f0-676d-46fb-ae23-136fb9d7a67d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:07.317579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1025/2028] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:07 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:07.318920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:07.329585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050edcb-5e4d-4fa0-ba1a-2463ceda3b94 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:07.359809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:07.400049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f97fb8-3e1f-4c86-b7f6-e0e8def4f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:07.400741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97fb8-3e1f-4c86-b7f6-e0e8def4f245 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.401026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97fb8-3e1f-4c86-b7f6-e0e8def4f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.401299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97fb8-3e1f-4c86-b7f6-e0e8def4f245 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.402024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f97fb8-3e1f-4c86-b7f6-e0e8def4f245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:07.403954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f97fb8-3e1f-4c86-b7f6-e0e8def4f245 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:07.429990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1004/2029] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:07 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:07.432604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda67f0-676d-46fb-ae23-136fb9d7a67d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:07.443478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda67f0-676d-46fb-ae23-136fb9d7a67d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:07.448053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d9e78-ad5f-4147-b59b-da8e1d7e5364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:07.449068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d9e78-ad5f-4147-b59b-da8e1d7e5364 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.449331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d9e78-ad5f-4147-b59b-da8e1d7e5364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.449625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d9e78-ad5f-4147-b59b-da8e1d7e5364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.450393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d9e78-ad5f-4147-b59b-da8e1d7e5364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:07.451979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d9e78-ad5f-4147-b59b-da8e1d7e5364 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:07.462754 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1026/2030] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:07.466665 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f97fb8-3e1f-4c86-b7f6-e0e8def4f245 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:07.476746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f97fb8-3e1f-4c86-b7f6-e0e8def4f245 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:07.481552 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6409-9be1-420a-a547-2e409d45a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:07.482258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6409-9be1-420a-a547-2e409d45a35a admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.482543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6409-9be1-420a-a547-2e409d45a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.482815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6409-9be1-420a-a547-2e409d45a35a admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.483547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd6409-9be1-420a-a547-2e409d45a35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:07.485192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd6409-9be1-420a-a547-2e409d45a35a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:07.495244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1005/2031] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:07.499207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d9e78-ad5f-4147-b59b-da8e1d7e5364 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:07.509930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d9e78-ad5f-4147-b59b-da8e1d7e5364 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:07.514985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:07.515902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.516183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.516458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] PATH_INFO: `/v3/projects/c1d1142c18b54c03a1106fb2d1f1b7ec/users/44e3430faccb4db28f9439ac4e13cf26/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.532345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d1142c18b54c03a1106fb2d1f1b7ec, user_id=44e3430faccb4db28f9439ac4e13cf26, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:07.535072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:07.549927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1027/2032] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:07 2022] PUT /identity/v3/projects/c1d1142c18b54c03a1106fb2d1f1b7ec/users/44e3430faccb4db28f9439ac4e13cf26/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:07.555258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b3e9-5bff-4940-8bf9-32a3d65f4128 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.555554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b3e9-5bff-4940-8bf9-32a3d65f4128 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.555853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081b3e9-5bff-4940-8bf9-32a3d65f4128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.574095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5081b3e9-5bff-4940-8bf9-32a3d65f4128 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:07.575312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5081b3e9-5bff-4940-8bf9-32a3d65f4128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:07.634135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1006/2033] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:07.644172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:07.646222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:07.706803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a91c7-ed69-492f-8d34-bb1f862c3a9d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:07.713350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff9a5-94e8-4f98-98df-106ff244f17b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:07.714237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff9a5-94e8-4f98-98df-106ff244f17b service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:07.714500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff9a5-94e8-4f98-98df-106ff244f17b service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:07.714904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff9a5-94e8-4f98-98df-106ff244f17b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:07.727285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ff9a5-94e8-4f98-98df-106ff244f17b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:07.729425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ff9a5-94e8-4f98-98df-106ff244f17b service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:07.740585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1028/2034] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:12.124862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd42f6-2b17-4f08-a52e-b95e853a1454 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:12.125326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd42f6-2b17-4f08-a52e-b95e853a1454 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:12.125417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd42f6-2b17-4f08-a52e-b95e853a1454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:12.157443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-fdfd42f6-2b17-4f08-a52e-b95e853a1454 None None] MFA Rules not processed for user `44e3430faccb4db28f9439ac4e13cf26`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:12.158610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fdfd42f6-2b17-4f08-a52e-b95e853a1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:12.230863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1007/2035] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:12.235374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff9a5-94e8-4f98-98df-106ff244f17b service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:12.245237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff9a5-94e8-4f98-98df-106ff244f17b service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:12.250077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6baae5-08c4-440b-94a3-781da1d4f401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:12.250741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6baae5-08c4-440b-94a3-781da1d4f401 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:12.251022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6baae5-08c4-440b-94a3-781da1d4f401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:12.251303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6baae5-08c4-440b-94a3-781da1d4f401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:12.252014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6baae5-08c4-440b-94a3-781da1d4f401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:12.254719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6baae5-08c4-440b-94a3-781da1d4f401 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:12.269901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:12.285716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1029/2036] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:12 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:12.289513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd42f6-2b17-4f08-a52e-b95e853a1454 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:12.310249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd42f6-2b17-4f08-a52e-b95e853a1454 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:12.350052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:12.379696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22120df0-089d-46c4-8f83-2bee9350b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:12.380419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22120df0-089d-46c4-8f83-2bee9350b79d admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:12.380703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22120df0-089d-46c4-8f83-2bee9350b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:12.380982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22120df0-089d-46c4-8f83-2bee9350b79d admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:12.381758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22120df0-089d-46c4-8f83-2bee9350b79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:12.383920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22120df0-089d-46c4-8f83-2bee9350b79d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:12.407517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1008/2037] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:12 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:12.411618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6baae5-08c4-440b-94a3-781da1d4f401 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:12.423958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6baae5-08c4-440b-94a3-781da1d4f401 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:12.428912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd2b73-b910-4264-912a-50ae026d8d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:12.429699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd2b73-b910-4264-912a-50ae026d8d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:12.430090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd2b73-b910-4264-912a-50ae026d8d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:12.430435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd2b73-b910-4264-912a-50ae026d8d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:12.431246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd2b73-b910-4264-912a-50ae026d8d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:12.432945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd2b73-b910-4264-912a-50ae026d8d21 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:12.445365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1030/2038] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:12.449840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22120df0-089d-46c4-8f83-2bee9350b79d admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:12.461479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22120df0-089d-46c4-8f83-2bee9350b79d admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:12.467622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369fb1-9cb3-4ad7-9b83-eef5cb7010c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:12.468592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369fb1-9cb3-4ad7-9b83-eef5cb7010c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:12.468927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369fb1-9cb3-4ad7-9b83-eef5cb7010c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:12.469212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1369fb1-9cb3-4ad7-9b83-eef5cb7010c6 admin admin] PATH_INFO: `/v3/projects/d7aa7c0318a1495e88eea54a51d4862a/users/e06730e5fcb6416286b0cc7ee82d3308/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:12.487289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1369fb1-9cb3-4ad7-9b83-eef5cb7010c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7aa7c0318a1495e88eea54a51d4862a, user_id=e06730e5fcb6416286b0cc7ee82d3308, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:12.489914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1369fb1-9cb3-4ad7-9b83-eef5cb7010c6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:12.505445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1009/2039] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:12 2022] PUT /identity/v3/projects/d7aa7c0318a1495e88eea54a51d4862a/users/e06730e5fcb6416286b0cc7ee82d3308/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:12.509454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd2b73-b910-4264-912a-50ae026d8d21 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:12.520117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd2b73-b910-4264-912a-50ae026d8d21 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:12.599784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfb6e0-06c1-4fde-b1ad-e45b70b25be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:12.600481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfb6e0-06c1-4fde-b1ad-e45b70b25be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:12.600761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfb6e0-06c1-4fde-b1ad-e45b70b25be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:12.601044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfb6e0-06c1-4fde-b1ad-e45b70b25be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:12.601795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfb6e0-06c1-4fde-b1ad-e45b70b25be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:12.603501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cfb6e0-06c1-4fde-b1ad-e45b70b25be2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:12.614573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1031/2040] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:12.618737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369fb1-9cb3-4ad7-9b83-eef5cb7010c6 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:12.629807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1369fb1-9cb3-4ad7-9b83-eef5cb7010c6 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:12.635246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:12.636459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:12.636883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:12.637305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] PATH_INFO: `/v3/projects/d7aa7c0318a1495e88eea54a51d4862a/users/e06730e5fcb6416286b0cc7ee82d3308/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:12.639712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7aa7c0318a1495e88eea54a51d4862a, user_id=e06730e5fcb6416286b0cc7ee82d3308, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:12.642653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:12.654079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1010/2041] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:12 2022] PUT /identity/v3/projects/d7aa7c0318a1495e88eea54a51d4862a/users/e06730e5fcb6416286b0cc7ee82d3308/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:16.473318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913edd-059f-45a3-9884-5c3403663664 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:16.474008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913edd-059f-45a3-9884-5c3403663664 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:16.474008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12913edd-059f-45a3-9884-5c3403663664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:16.504214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-12913edd-059f-45a3-9884-5c3403663664 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:16.505886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-12913edd-059f-45a3-9884-5c3403663664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:16.695148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1032/2042] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:41:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:16.763507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:16.765578 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:16.953730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5db1d1-1561-4353-80bc-a7c5ea4b7d81 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:16.960139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:16.961064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:16.961444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:16.961807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:16.973141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:16.975062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:16.999391 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1011/2043] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:41:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:41:17.871502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44b094-2700-4549-8957-e40755ffc3bc None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:17.872052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44b094-2700-4549-8957-e40755ffc3bc None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:17.872052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44b094-2700-4549-8957-e40755ffc3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:17.916841 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ae44b094-2700-4549-8957-e40755ffc3bc None None] MFA Rules not processed for user `e06730e5fcb6416286b0cc7ee82d3308`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:17.923638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ae44b094-2700-4549-8957-e40755ffc3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:18.135876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1033/2044] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:18.149846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:18.151378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:18.299815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:18.324000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69048c-c838-471d-9a38-56356b329739 service swift] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:18.329970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:18.330887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:18.331260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:18.331632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:18.423578 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:18.427425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:18.454265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1012/2045] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:20.303612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009ea0b-2872-4f65-8a12-ebb80cfed4f8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:20.304232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009ea0b-2872-4f65-8a12-ebb80cfed4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:20.304366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009ea0b-2872-4f65-8a12-ebb80cfed4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:20.312844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:20.328179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-7009ea0b-2872-4f65-8a12-ebb80cfed4f8 None None] MFA Rules not processed for user `44e3430faccb4db28f9439ac4e13cf26`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:20.329780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7009ea0b-2872-4f65-8a12-ebb80cfed4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:20.342302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1034/2046] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:21.947234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:21.949208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:22.056209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc9cd2-1868-4392-8300-3836e499ab98 service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:22.064912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:22.066319 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:22.067194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:22.067194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] PATH_INFO: `/v3/users/3e6bb3c13e6e4304bc7db5e7edb6929d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:22.068205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6bb3c13e6e4304bc7db5e7edb6929d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:22.070203 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:22.164747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6bb3c13e6e4304bc7db5e7edb6929d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:22.167075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6bb3c13e6e4304bc7db5e7edb6929d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:22.179848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6bb3c13e6e4304bc7db5e7edb6929d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:22.198763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6bb3c13e6e4304bc7db5e7edb6929d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:22.230412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6bb3c13e6e4304bc7db5e7edb6929d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:22.244142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1013/2047] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:21 2022] DELETE /identity/v3/users/3e6bb3c13e6e4304bc7db5e7edb6929d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:22.248842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3cefb-2651-45be-aed1-b197c732c473 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:22.249864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3cefb-2651-45be-aed1-b197c732c473 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:22.250415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3cefb-2651-45be-aed1-b197c732c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:22.271420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-81e3cefb-2651-45be-aed1-b197c732c473 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:22.273078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-81e3cefb-2651-45be-aed1-b197c732c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:22.353691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1035/2048] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:22.362978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:22.364833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:22.395294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:22.463897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91f30b-a473-42b4-9813-48964271ee90 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:22.468722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:22.469013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:22.469237 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:22.469614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:22.489381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:22.492462 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:22.511497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1014/2049] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:23.106853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc07b3-6546-44bb-89ed-c5c30c9f4e3e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.107555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc07b3-6546-44bb-89ed-c5c30c9f4e3e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.107992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc07b3-6546-44bb-89ed-c5c30c9f4e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.148259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-fefc07b3-6546-44bb-89ed-c5c30c9f4e3e None None] MFA Rules not processed for user `bf5ff69a857f412fb65dce1b59a22e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:23.149755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fefc07b3-6546-44bb-89ed-c5c30c9f4e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:23.164983 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:23.167634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:23.197890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a1461-c338-4b34-88e5-ea20f4ea1d07 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:23.210335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:23.211314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.211602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.212946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] PATH_INFO: `/v3/projects/701cbc222601443c8fc3205bb11a046b` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.213424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=701cbc222601443c8fc3205bb11a046b)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:23.216150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:23.318971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1036/2050] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:23.355998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701cbc222601443c8fc3205bb11a046b', 'request_id': 'req-c345c451-5d21-47f0-baac-0d5daf1794ab'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.400732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701cbc222601443c8fc3205bb11a046b', 'request_id': 'req-c345c451-5d21-47f0-baac-0d5daf1794ab'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.408296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701cbc222601443c8fc3205bb11a046b', 'request_id': 'req-c345c451-5d21-47f0-baac-0d5daf1794ab'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.439025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] The token cache is being invalidate because project 701cbc222601443c8fc3205bb11a046b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:23.439465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.441060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c345c451-5d21-47f0-baac-0d5daf1794ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:23.443529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1015/2051] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:23 2022] DELETE /identity/v3/projects/701cbc222601443c8fc3205bb11a046b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:23.449160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0fba-deca-48a9-8fce-f59f13b4b2e1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.449455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0fba-deca-48a9-8fce-f59f13b4b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.449762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d0fba-deca-48a9-8fce-f59f13b4b2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.525755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-929d0fba-deca-48a9-8fce-f59f13b4b2e1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:23.527724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-929d0fba-deca-48a9-8fce-f59f13b4b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:23.652679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1037/2052] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:23.654503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302064e-afcd-4ad6-9d0f-5cfd19bbd19c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.654898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302064e-afcd-4ad6-9d0f-5cfd19bbd19c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.655281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302064e-afcd-4ad6-9d0f-5cfd19bbd19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.676968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1302064e-afcd-4ad6-9d0f-5cfd19bbd19c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:23.678495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1302064e-afcd-4ad6-9d0f-5cfd19bbd19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:23.688379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1016/2053] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:23.692529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d0fba-deca-48a9-8fce-f59f13b4b2e1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:23.711910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d0fba-deca-48a9-8fce-f59f13b4b2e1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:23.724877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:23.726422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.726884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.727177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.728166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:23.728495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:23.730529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:23.762371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1038/2054] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:41:23.767634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302064e-afcd-4ad6-9d0f-5cfd19bbd19c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:23.778191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302064e-afcd-4ad6-9d0f-5cfd19bbd19c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:23.785452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9dfb-1ca0-4a08-9daa-bd83c583d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:23.786473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9dfb-1ca0-4a08-9daa-bd83c583d931 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.787220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9dfb-1ca0-4a08-9daa-bd83c583d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.787616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9dfb-1ca0-4a08-9daa-bd83c583d931 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.788424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9dfb-1ca0-4a08-9daa-bd83c583d931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:23.791338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9dfb-1ca0-4a08-9daa-bd83c583d931 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:23.836015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1017/2055] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:23 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:23.838165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:23.859959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e49b-07c7-4883-8622-54e6126152d5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:23.933990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:23.972179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f539020-4e64-459c-824a-dbb6c0828937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:23.973130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f539020-4e64-459c-824a-dbb6c0828937 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:23.973894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f539020-4e64-459c-824a-dbb6c0828937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:23.973894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f539020-4e64-459c-824a-dbb6c0828937 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:23.975417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f539020-4e64-459c-824a-dbb6c0828937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:23.977651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f539020-4e64-459c-824a-dbb6c0828937 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.009116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1039/2056] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:23 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:24.012976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9dfb-1ca0-4a08-9daa-bd83c583d931 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.024233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9dfb-1ca0-4a08-9daa-bd83c583d931 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.035023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934ed4-0c66-4c48-8a1d-1791cffc4a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.035678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934ed4-0c66-4c48-8a1d-1791cffc4a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.035962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934ed4-0c66-4c48-8a1d-1791cffc4a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.036393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934ed4-0c66-4c48-8a1d-1791cffc4a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.037020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb934ed4-0c66-4c48-8a1d-1791cffc4a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.039422 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb934ed4-0c66-4c48-8a1d-1791cffc4a44 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.051294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1018/2057] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:24.061067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f539020-4e64-459c-824a-dbb6c0828937 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.071387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f539020-4e64-459c-824a-dbb6c0828937 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.083017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a322800-ff70-40b4-b06c-898f8fa499ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.084075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a322800-ff70-40b4-b06c-898f8fa499ad admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.084278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a322800-ff70-40b4-b06c-898f8fa499ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.084782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a322800-ff70-40b4-b06c-898f8fa499ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.085864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a322800-ff70-40b4-b06c-898f8fa499ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.087489 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a322800-ff70-40b4-b06c-898f8fa499ad admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.102256 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1040/2058] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:24.108657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934ed4-0c66-4c48-8a1d-1791cffc4a44 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.134091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934ed4-0c66-4c48-8a1d-1791cffc4a44 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.139522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fbf66-68b2-4e1a-abf4-593185809b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.140594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fbf66-68b2-4e1a-abf4-593185809b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.140975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fbf66-68b2-4e1a-abf4-593185809b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.141349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fbf66-68b2-4e1a-abf4-593185809b13 admin admin] PATH_INFO: `/v3/projects/f31206e0a1d940b9afd09070fface20d/users/2ed65265a8ac4a17a229efd6fc6b7e37/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.160331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fbf66-68b2-4e1a-abf4-593185809b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31206e0a1d940b9afd09070fface20d, user_id=2ed65265a8ac4a17a229efd6fc6b7e37, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.163943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fbf66-68b2-4e1a-abf4-593185809b13 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.194355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1019/2059] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:24 2022] PUT /identity/v3/projects/f31206e0a1d940b9afd09070fface20d/users/2ed65265a8ac4a17a229efd6fc6b7e37/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:24.197111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc77c9-8e07-4108-b35d-746dc16808cc None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.197593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc77c9-8e07-4108-b35d-746dc16808cc None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.198448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc77c9-8e07-4108-b35d-746dc16808cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.240263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-7fbc77c9-8e07-4108-b35d-746dc16808cc None None] MFA Rules not processed for user `2ed65265a8ac4a17a229efd6fc6b7e37`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:24.242844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7fbc77c9-8e07-4108-b35d-746dc16808cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:24.393313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1041/2060] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:24.397722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fbf66-68b2-4e1a-abf4-593185809b13 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.461633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:24.504920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fbf66-68b2-4e1a-abf4-593185809b13 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.514455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b86b7-135c-4dc5-a28a-2ef080c0bd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.515584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b86b7-135c-4dc5-a28a-2ef080c0bd08 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.515971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b86b7-135c-4dc5-a28a-2ef080c0bd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.516402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b86b7-135c-4dc5-a28a-2ef080c0bd08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.517311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b86b7-135c-4dc5-a28a-2ef080c0bd08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.519757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b86b7-135c-4dc5-a28a-2ef080c0bd08 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.574007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1020/2061] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:24 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:24.580260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc77c9-8e07-4108-b35d-746dc16808cc None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.616225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc77c9-8e07-4108-b35d-746dc16808cc None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.708913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bcedb-7152-4256-bc66-8726edf0bb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.710300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcedb-7152-4256-bc66-8726edf0bb61 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.711231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcedb-7152-4256-bc66-8726edf0bb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.711231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bcedb-7152-4256-bc66-8726edf0bb61 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.712061 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bcedb-7152-4256-bc66-8726edf0bb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.714775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bcedb-7152-4256-bc66-8726edf0bb61 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.759035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1042/2062] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:24 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:24.760009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b86b7-135c-4dc5-a28a-2ef080c0bd08 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.780101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b86b7-135c-4dc5-a28a-2ef080c0bd08 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.810249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa34dd-bb64-4d71-8fdd-83f371c7e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.810929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa34dd-bb64-4d71-8fdd-83f371c7e722 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.811209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa34dd-bb64-4d71-8fdd-83f371c7e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.811567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa34dd-bb64-4d71-8fdd-83f371c7e722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.813055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa34dd-bb64-4d71-8fdd-83f371c7e722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.816981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa34dd-bb64-4d71-8fdd-83f371c7e722 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.854701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1021/2063] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:24.856468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bcedb-7152-4256-bc66-8726edf0bb61 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:24.875160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bcedb-7152-4256-bc66-8726edf0bb61 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:24.884474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996af265-2fe3-4dea-99cc-a059a1e90458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:24.885840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996af265-2fe3-4dea-99cc-a059a1e90458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:24.886426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996af265-2fe3-4dea-99cc-a059a1e90458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:24.886939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996af265-2fe3-4dea-99cc-a059a1e90458 admin admin] PATH_INFO: `/v3/projects/cf072326a93b47148ce769ea6dc6e1b8/users/b4b0ebd21c494cb7b3e094bad7973544/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:24.952980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996af265-2fe3-4dea-99cc-a059a1e90458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf072326a93b47148ce769ea6dc6e1b8, user_id=b4b0ebd21c494cb7b3e094bad7973544, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:24.955983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996af265-2fe3-4dea-99cc-a059a1e90458 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:24.995280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1043/2064] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:24 2022] PUT /identity/v3/projects/cf072326a93b47148ce769ea6dc6e1b8/users/b4b0ebd21c494cb7b3e094bad7973544/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:24.999811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa34dd-bb64-4d71-8fdd-83f371c7e722 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:25.016673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa34dd-bb64-4d71-8fdd-83f371c7e722 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:25.162475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fcdf5-563c-4f99-bd3f-c7a325722264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:25.163688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fcdf5-563c-4f99-bd3f-c7a325722264 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.164202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fcdf5-563c-4f99-bd3f-c7a325722264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.164502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fcdf5-563c-4f99-bd3f-c7a325722264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.166062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fcdf5-563c-4f99-bd3f-c7a325722264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:25.169491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fcdf5-563c-4f99-bd3f-c7a325722264 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.198568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1022/2065] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:25.202597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996af265-2fe3-4dea-99cc-a059a1e90458 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:25.215736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:25.224178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996af265-2fe3-4dea-99cc-a059a1e90458 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:25.234485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:25.235794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.236182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.236561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] PATH_INFO: `/v3/projects/cf072326a93b47148ce769ea6dc6e1b8/users/b4b0ebd21c494cb7b3e094bad7973544/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.239428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf072326a93b47148ce769ea6dc6e1b8, user_id=b4b0ebd21c494cb7b3e094bad7973544, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:25.244568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.269323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1044/2066] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:25 2022] PUT /identity/v3/projects/cf072326a93b47148ce769ea6dc6e1b8/users/b4b0ebd21c494cb7b3e094bad7973544/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:25.283318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9704703-81f0-4d23-b82c-d046b22b815f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.283896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9704703-81f0-4d23-b82c-d046b22b815f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.284326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9704703-81f0-4d23-b82c-d046b22b815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.368890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f9704703-81f0-4d23-b82c-d046b22b815f None None] MFA Rules not processed for user `b4b0ebd21c494cb7b3e094bad7973544`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:25.370757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f9704703-81f0-4d23-b82c-d046b22b815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:25.506089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1023/2067] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:25.526843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:25.528494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:25.634995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44099955-cfad-47f1-8147-d4df658c2e6f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:25.640217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c495c-61ce-491b-96dc-c12038903a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:25.640927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c495c-61ce-491b-96dc-c12038903a14 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.641186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c495c-61ce-491b-96dc-c12038903a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.641471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c495c-61ce-491b-96dc-c12038903a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.656246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c495c-61ce-491b-96dc-c12038903a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:25.657775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c495c-61ce-491b-96dc-c12038903a14 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.673714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1045/2068] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:25.785923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9704703-81f0-4d23-b82c-d046b22b815f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:25.797864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9704703-81f0-4d23-b82c-d046b22b815f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:25.804852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:25.804852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:25.804852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:25.804852 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:25.866996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:25.908855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:25.910451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:25.926760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1024/2069] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:35.668593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:35.919370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=14 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:39.646691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d32bd-0203-4636-ab56-4731d66e4b27 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.647272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d32bd-0203-4636-ab56-4731d66e4b27 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.647272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d32bd-0203-4636-ab56-4731d66e4b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.698683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-9d7d32bd-0203-4636-ab56-4731d66e4b27 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:39.699961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9d7d32bd-0203-4636-ab56-4731d66e4b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:39.784867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1046/2070] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jul 1 19:41:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:39.798773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:39.800175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:39.899236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437af61a-881f-4816-9460-f8b5de10851c service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:39.904418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5e3dc-79c7-4b2f-bbaf-fb4b4fb8a652 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:39.905126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e3dc-79c7-4b2f-bbaf-fb4b4fb8a652 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:39.905469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e3dc-79c7-4b2f-bbaf-fb4b4fb8a652 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:39.905805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5e3dc-79c7-4b2f-bbaf-fb4b4fb8a652 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:39.916543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5e3dc-79c7-4b2f-bbaf-fb4b4fb8a652 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:39.918692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5e3dc-79c7-4b2f-bbaf-fb4b4fb8a652 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:39.933826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1025/2071] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:41:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:41:40.491457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d32bd-0203-4636-ab56-4731d66e4b27 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:40.569548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d32bd-0203-4636-ab56-4731d66e4b27 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:40.576610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:40.577517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:40.577797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:40.578124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] PATH_INFO: `/v3/users/2ed65265a8ac4a17a229efd6fc6b7e37` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:40.579332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed65265a8ac4a17a229efd6fc6b7e37)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:40.581284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:40.633192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed65265a8ac4a17a229efd6fc6b7e37'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:40.640996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed65265a8ac4a17a229efd6fc6b7e37'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:40.641626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed65265a8ac4a17a229efd6fc6b7e37'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:40.648851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed65265a8ac4a17a229efd6fc6b7e37'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:40.657085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:40.663043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed65265a8ac4a17a229efd6fc6b7e37'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:40.670383 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1047/2072] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:40 2022] DELETE /identity/v3/users/2ed65265a8ac4a17a229efd6fc6b7e37 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:40.674933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d895c-0bd5-40d8-8281-931c6fd5b0d0 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:40.675286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d895c-0bd5-40d8-8281-931c6fd5b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:40.675568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d895c-0bd5-40d8-8281-931c6fd5b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:40.694013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-de0d895c-0bd5-40d8-8281-931c6fd5b0d0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:40.695419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-de0d895c-0bd5-40d8-8281-931c6fd5b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:40.765078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1026/2073] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:40.775124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:40.776835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:40.837780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fa09f-4e43-4fa3-9e8c-9cebd0246687 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:40.841704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660829-9870-44e5-badc-bdbcdf22b718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:40.842386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660829-9870-44e5-badc-bdbcdf22b718 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:40.842670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660829-9870-44e5-badc-bdbcdf22b718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:40.842930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87660829-9870-44e5-badc-bdbcdf22b718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:40.853625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87660829-9870-44e5-badc-bdbcdf22b718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:40.855421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87660829-9870-44e5-badc-bdbcdf22b718 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:40.865433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1048/2074] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:41.139331 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d895c-0bd5-40d8-8281-931c6fd5b0d0 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:41.140904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-de0d895c-0bd5-40d8-8281-931c6fd5b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:41.153153 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d895c-0bd5-40d8-8281-931c6fd5b0d0 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:41.158871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:41.159886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:41.160322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:41.160622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] PATH_INFO: `/v3/projects/f31206e0a1d940b9afd09070fface20d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:41.161896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31206e0a1d940b9afd09070fface20d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:41.164146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:41.218058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31206e0a1d940b9afd09070fface20d', 'request_id': 'req-39cc123a-50d0-43fe-8bde-d33c021d20aa'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.226575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31206e0a1d940b9afd09070fface20d', 'request_id': 'req-39cc123a-50d0-43fe-8bde-d33c021d20aa'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.232612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31206e0a1d940b9afd09070fface20d', 'request_id': 'req-39cc123a-50d0-43fe-8bde-d33c021d20aa'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.233870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:41.247369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] The token cache is being invalidate because project f31206e0a1d940b9afd09070fface20d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:41.247877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.248662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.250401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1027/2075] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:41 2022] DELETE /identity/v3/projects/f31206e0a1d940b9afd09070fface20d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:41.254523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660829-9870-44e5-badc-bdbcdf22b718 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:41.264417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87660829-9870-44e5-badc-bdbcdf22b718 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:41.320484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:41.321358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:41.321645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:41.321924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] PATH_INFO: `/v3/users/b4b0ebd21c494cb7b3e094bad7973544` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:41.323516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b0ebd21c494cb7b3e094bad7973544)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:41.325468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:41.374823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b0ebd21c494cb7b3e094bad7973544'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.383090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b0ebd21c494cb7b3e094bad7973544'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.383729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b0ebd21c494cb7b3e094bad7973544'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.391253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b0ebd21c494cb7b3e094bad7973544'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.404094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5a32233c-5044-493c-a12e-00c815d5cfb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b0ebd21c494cb7b3e094bad7973544'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:41.410071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1049/2076] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:41 2022] DELETE /identity/v3/users/b4b0ebd21c494cb7b3e094bad7973544 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:41.837550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:41.839255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:41.856807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc123a-50d0-43fe-8bde-d33c021d20aa admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:41.928323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:41.929273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:41.929546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:41.929838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] PATH_INFO: `/v3/projects/cf072326a93b47148ce769ea6dc6e1b8` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:41.931126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf072326a93b47148ce769ea6dc6e1b8)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:41.933059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:41.990495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf072326a93b47148ce769ea6dc6e1b8', 'request_id': 'req-2c1ebf65-610f-4bb0-9554-29857199af9b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.000458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf072326a93b47148ce769ea6dc6e1b8', 'request_id': 'req-2c1ebf65-610f-4bb0-9554-29857199af9b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.009717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf072326a93b47148ce769ea6dc6e1b8', 'request_id': 'req-2c1ebf65-610f-4bb0-9554-29857199af9b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.022637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] The token cache is being invalidate because project cf072326a93b47148ce769ea6dc6e1b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:42.022964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.023705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.025517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1028/2077] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:41 2022] DELETE /identity/v3/projects/cf072326a93b47148ce769ea6dc6e1b8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:42.030618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc797e-ffbf-442c-b559-75509c5db6a5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.031108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc797e-ffbf-442c-b559-75509c5db6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.031203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc797e-ffbf-442c-b559-75509c5db6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.053910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-08cc797e-ffbf-442c-b559-75509c5db6a5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:42.055696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-08cc797e-ffbf-442c-b559-75509c5db6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.066749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.068804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.074226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:42.127970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1050/2078] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:42.135871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c76323-5117-46b2-8ae2-366fbf5c0111 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.136167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c76323-5117-46b2-8ae2-366fbf5c0111 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.136431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c76323-5117-46b2-8ae2-366fbf5c0111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.142149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1ebf65-610f-4bb0-9554-29857199af9b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.146916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.147797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.148076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.148375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] PATH_INFO: `/v3/users/c8d8523e71264696997f23122115687a` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.149573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d8523e71264696997f23122115687a)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.151644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.155442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-03c76323-5117-46b2-8ae2-366fbf5c0111 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:42.156761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-03c76323-5117-46b2-8ae2-366fbf5c0111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.165027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1051/2079] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:42.169314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c76323-5117-46b2-8ae2-366fbf5c0111 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.178555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c76323-5117-46b2-8ae2-366fbf5c0111 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.183614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:42.183775 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.184404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.184662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.184936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.185853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:42.186193 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.188068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.201991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1052/2080] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:41:42.205924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.206676 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d8523e71264696997f23122115687a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.207322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d8523e71264696997f23122115687a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.216386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8595824-8ecf-40fd-be96-de0656787673 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.217150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d8523e71264696997f23122115687a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.221921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.222692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.223047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.223392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.224175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.226273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d8523e71264696997f23122115687a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.226588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.241353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d8523e71264696997f23122115687a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.249313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1029/2081] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:41:42 2022] DELETE /identity/v3/users/c8d8523e71264696997f23122115687a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:42.257732 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1053/2082] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:42.261596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.263176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.343116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2747668-2f2f-4376-8abc-53648eb6eb47 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.418107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee195b3-f104-459e-ab41-1501e55696d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.418800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee195b3-f104-459e-ab41-1501e55696d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.419213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee195b3-f104-459e-ab41-1501e55696d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.419575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee195b3-f104-459e-ab41-1501e55696d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.420217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee195b3-f104-459e-ab41-1501e55696d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.422207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee195b3-f104-459e-ab41-1501e55696d4 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.446620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1030/2083] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/users => generated 279 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:42.446783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.447864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee195b3-f104-459e-ab41-1501e55696d4 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.449291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.462231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee195b3-f104-459e-ab41-1501e55696d4 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.467855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf6df-c45a-440b-bfc9-e1ca032eee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.468186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d83c4-63db-4a75-8263-2915fd0fd3cc admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.468691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf6df-c45a-440b-bfc9-e1ca032eee2f admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.469103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf6df-c45a-440b-bfc9-e1ca032eee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.469388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf6df-c45a-440b-bfc9-e1ca032eee2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.470894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf6df-c45a-440b-bfc9-e1ca032eee2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.473289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf6df-c45a-440b-bfc9-e1ca032eee2f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.482640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.483537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.483839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.484195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] PATH_INFO: `/v3/projects/fd410d5a356243c6b7b71cfb958fcdfc` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.484716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1031/2084] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:42.485411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd410d5a356243c6b7b71cfb958fcdfc)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.487438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.488631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf6df-c45a-440b-bfc9-e1ca032eee2f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.499296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf6df-c45a-440b-bfc9-e1ca032eee2f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.504266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8419-708c-4b7c-a569-bbbc43aefd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.505029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8419-708c-4b7c-a569-bbbc43aefd5b admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.505313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8419-708c-4b7c-a569-bbbc43aefd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.505589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8419-708c-4b7c-a569-bbbc43aefd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.506400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f8419-708c-4b7c-a569-bbbc43aefd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.508003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f8419-708c-4b7c-a569-bbbc43aefd5b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.521983 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1032/2085] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:42.524568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8419-708c-4b7c-a569-bbbc43aefd5b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.534289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8419-708c-4b7c-a569-bbbc43aefd5b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.540714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd410d5a356243c6b7b71cfb958fcdfc', 'request_id': 'req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.547301 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:42.549025 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd410d5a356243c6b7b71cfb958fcdfc', 'request_id': 'req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.554836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd410d5a356243c6b7b71cfb958fcdfc', 'request_id': 'req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.566271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] The token cache is being invalidate because project fd410d5a356243c6b7b71cfb958fcdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:41:42.566559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.567257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f2767834-cde9-42d6-8cf7-fbfd82aadd0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:41:42.569324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1054/2086] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:41:42 2022] DELETE /identity/v3/projects/fd410d5a356243c6b7b71cfb958fcdfc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:42.574698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5ae9-a265-4618-9718-e0f0a9de07da None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.574989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5ae9-a265-4618-9718-e0f0a9de07da None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.575268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b5ae9-a265-4618-9718-e0f0a9de07da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.593546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-573b5ae9-a265-4618-9718-e0f0a9de07da None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:42.594706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f949-46d8-4073-a247-1f3812bb7f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.595043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-573b5ae9-a265-4618-9718-e0f0a9de07da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.595639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f949-46d8-4073-a247-1f3812bb7f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.595912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f949-46d8-4073-a247-1f3812bb7f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.596190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f949-46d8-4073-a247-1f3812bb7f2e admin admin] PATH_INFO: `/v3/projects/488c24aa331a4fec8c72b71089f24a44/users/f1e662cab4cd446f997c74a690d40454/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.603743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1055/2087] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:42.612269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c174-5ebc-421f-9414-0bb66af6f722 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.612817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c174-5ebc-421f-9414-0bb66af6f722 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.613142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1c174-5ebc-421f-9414-0bb66af6f722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.617465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3f949-46d8-4073-a247-1f3812bb7f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=488c24aa331a4fec8c72b71089f24a44, user_id=f1e662cab4cd446f997c74a690d40454, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.620286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3f949-46d8-4073-a247-1f3812bb7f2e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.633050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4ba1c174-5ebc-421f-9414-0bb66af6f722 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:42.634152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1033/2088] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:42 2022] PUT /identity/v3/projects/488c24aa331a4fec8c72b71089f24a44/users/f1e662cab4cd446f997c74a690d40454/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:42.642987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4ba1c174-5ebc-421f-9414-0bb66af6f722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.644812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4f43-abe9-4881-a631-518e0fedf2f6 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.645108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4f43-abe9-4881-a631-518e0fedf2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.645431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa4f43-abe9-4881-a631-518e0fedf2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.675063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-e0fa4f43-abe9-4881-a631-518e0fedf2f6 None None] MFA Rules not processed for user `f1e662cab4cd446f997c74a690d40454`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:42.676489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e0fa4f43-abe9-4881-a631-518e0fedf2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.680267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:42.697782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1056/2089] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:42.702329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1c174-5ebc-421f-9414-0bb66af6f722 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.711589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1c174-5ebc-421f-9414-0bb66af6f722 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.717637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.718344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.718627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.718908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.719701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:41:42.720011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.721623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.733838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1057/2090] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:41:42.738086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.743378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1034/2091] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:42.747976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa4f43-abe9-4881-a631-518e0fedf2f6 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.749073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c6727-8685-4e03-a3a4-ca9c369bc51f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.749443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e0fa4f43-abe9-4881-a631-518e0fedf2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:42.753581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e7b5b-50ab-4bdd-a29c-3574bb56ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.754283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7b5b-50ab-4bdd-a29c-3574bb56ee0d admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.754560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7b5b-50ab-4bdd-a29c-3574bb56ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.754834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e7b5b-50ab-4bdd-a29c-3574bb56ee0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.755525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e7b5b-50ab-4bdd-a29c-3574bb56ee0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.757459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e7b5b-50ab-4bdd-a29c-3574bb56ee0d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.762891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa4f43-abe9-4881-a631-518e0fedf2f6 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.767863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473593d1-8711-451a-a8dc-d66cbba08e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.768890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473593d1-8711-451a-a8dc-d66cbba08e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.769170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473593d1-8711-451a-a8dc-d66cbba08e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.769441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473593d1-8711-451a-a8dc-d66cbba08e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.770176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473593d1-8711-451a-a8dc-d66cbba08e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.772283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473593d1-8711-451a-a8dc-d66cbba08e4c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.784135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1058/2092] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:42.788428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e7b5b-50ab-4bdd-a29c-3574bb56ee0d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.802188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1035/2093] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:41:42.803254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473593d1-8711-451a-a8dc-d66cbba08e4c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.854017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e7b5b-50ab-4bdd-a29c-3574bb56ee0d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.864065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473593d1-8711-451a-a8dc-d66cbba08e4c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.868814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e226dc2-9330-4c38-bb5c-a00d23e3c394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.869554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e226dc2-9330-4c38-bb5c-a00d23e3c394 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.869840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e226dc2-9330-4c38-bb5c-a00d23e3c394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.870168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e226dc2-9330-4c38-bb5c-a00d23e3c394 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.870863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e226dc2-9330-4c38-bb5c-a00d23e3c394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.872802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e226dc2-9330-4c38-bb5c-a00d23e3c394 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.888707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:42.895942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1036/2094] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:42.900368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e226dc2-9330-4c38-bb5c-a00d23e3c394 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.910495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e226dc2-9330-4c38-bb5c-a00d23e3c394 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.913142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2be9a-b085-4237-af8f-41e75371ab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.913828 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2be9a-b085-4237-af8f-41e75371ab27 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.914144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2be9a-b085-4237-af8f-41e75371ab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.914428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2be9a-b085-4237-af8f-41e75371ab27 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.915126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2be9a-b085-4237-af8f-41e75371ab27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.915911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b5d7-30b8-4d7e-8d1d-8cfc02f57854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.916628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b5d7-30b8-4d7e-8d1d-8cfc02f57854 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.916910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b5d7-30b8-4d7e-8d1d-8cfc02f57854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.917177 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15b5d7-30b8-4d7e-8d1d-8cfc02f57854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.917622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2be9a-b085-4237-af8f-41e75371ab27 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.918088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15b5d7-30b8-4d7e-8d1d-8cfc02f57854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.919914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe15b5d7-30b8-4d7e-8d1d-8cfc02f57854 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.931468 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1037/2095] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:41:42.935864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b5d7-30b8-4d7e-8d1d-8cfc02f57854 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.946611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1059/2096] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:41:42 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:41:42.946783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15b5d7-30b8-4d7e-8d1d-8cfc02f57854 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.949443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2be9a-b085-4237-af8f-41e75371ab27 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.951811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c180d4-d5fc-4c0d-9445-a3a67d15148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.952818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c180d4-d5fc-4c0d-9445-a3a67d15148b admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.953095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c180d4-d5fc-4c0d-9445-a3a67d15148b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.953363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c180d4-d5fc-4c0d-9445-a3a67d15148b admin admin] PATH_INFO: `/v3/projects/b434407b24ce4ed3a527c486ec873de8/users/30d80bfec48546218c5b93b5b30252e0/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.959917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2be9a-b085-4237-af8f-41e75371ab27 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:42.964611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e9d7-dda0-480a-85de-4dfb7194f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:42.965269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e9d7-dda0-480a-85de-4dfb7194f506 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:42.965553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e9d7-dda0-480a-85de-4dfb7194f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:42.965838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e9d7-dda0-480a-85de-4dfb7194f506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:42.966615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0e9d7-dda0-480a-85de-4dfb7194f506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.968211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0e9d7-dda0-480a-85de-4dfb7194f506 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.968559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c180d4-d5fc-4c0d-9445-a3a67d15148b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b434407b24ce4ed3a527c486ec873de8, user_id=30d80bfec48546218c5b93b5b30252e0, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:42.971231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c180d4-d5fc-4c0d-9445-a3a67d15148b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:42.979032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1060/2097] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:42.983138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e9d7-dda0-480a-85de-4dfb7194f506 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.986471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1038/2098] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:42 2022] PUT /identity/v3/projects/b434407b24ce4ed3a527c486ec873de8/users/30d80bfec48546218c5b93b5b30252e0/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:42.990126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c180d4-d5fc-4c0d-9445-a3a67d15148b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:42.995803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e9d7-dda0-480a-85de-4dfb7194f506 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.033982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:43.053353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c180d4-d5fc-4c0d-9445-a3a67d15148b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.054263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaa81f-efc2-4dc0-b639-8ae4449ad2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.054922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaa81f-efc2-4dc0-b639-8ae4449ad2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.055207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaa81f-efc2-4dc0-b639-8ae4449ad2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.055486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aaa81f-efc2-4dc0-b639-8ae4449ad2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.056227 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aaa81f-efc2-4dc0-b639-8ae4449ad2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.057873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aaa81f-efc2-4dc0-b639-8ae4449ad2b7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.064211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d29d-4bd5-4a33-9c75-2fd7075b75cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.064889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d29d-4bd5-4a33-9c75-2fd7075b75cf admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.065175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d29d-4bd5-4a33-9c75-2fd7075b75cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.065452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d29d-4bd5-4a33-9c75-2fd7075b75cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.066221 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5d29d-4bd5-4a33-9c75-2fd7075b75cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.067835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5d29d-4bd5-4a33-9c75-2fd7075b75cf admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.068154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1061/2099] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:43.072480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaa81f-efc2-4dc0-b639-8ae4449ad2b7 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.078514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1039/2100] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:41:43.082436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d29d-4bd5-4a33-9c75-2fd7075b75cf admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.082563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aaa81f-efc2-4dc0-b639-8ae4449ad2b7 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.087312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dd430-71e2-4051-a4d6-063405886858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.088212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd430-71e2-4051-a4d6-063405886858 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.088493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd430-71e2-4051-a4d6-063405886858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.088750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd430-71e2-4051-a4d6-063405886858 admin admin] PATH_INFO: `/v3/projects/bfa295b828cf4aaaab2ee5bb2f14d5f6/users/b4bf96fbc0fb4efca7921e4ec2b279ec/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.092178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d29d-4bd5-4a33-9c75-2fd7075b75cf admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.096672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e138d2-ba41-4e91-8545-d8bf363ff5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.097544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e138d2-ba41-4e91-8545-d8bf363ff5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.097829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e138d2-ba41-4e91-8545-d8bf363ff5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.098146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e138d2-ba41-4e91-8545-d8bf363ff5ee admin admin] PATH_INFO: `/v3/projects/b434407b24ce4ed3a527c486ec873de8/users/30d80bfec48546218c5b93b5b30252e0/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.100265 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e138d2-ba41-4e91-8545-d8bf363ff5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b434407b24ce4ed3a527c486ec873de8, user_id=30d80bfec48546218c5b93b5b30252e0, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.103118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e138d2-ba41-4e91-8545-d8bf363ff5ee admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.103916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dd430-71e2-4051-a4d6-063405886858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa295b828cf4aaaab2ee5bb2f14d5f6, user_id=b4bf96fbc0fb4efca7921e4ec2b279ec, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.107294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dd430-71e2-4051-a4d6-063405886858 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.113924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1040/2101] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:43 2022] PUT /identity/v3/projects/b434407b24ce4ed3a527c486ec873de8/users/30d80bfec48546218c5b93b5b30252e0/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:41:43.123825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1062/2102] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:41:43 2022] PUT /identity/v3/projects/bfa295b828cf4aaaab2ee5bb2f14d5f6/users/b4bf96fbc0fb4efca7921e4ec2b279ec/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:41:43.127849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a135ea-45df-4602-877f-f267a84de532 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.128247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a135ea-45df-4602-877f-f267a84de532 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.128639 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a135ea-45df-4602-877f-f267a84de532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.132101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d1143-d021-46dc-bf35-cd6e8768b162 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.132387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d1143-d021-46dc-bf35-cd6e8768b162 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.132660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d1143-d021-46dc-bf35-cd6e8768b162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.157514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b6a135ea-45df-4602-877f-f267a84de532 None None] MFA Rules not processed for user `30d80bfec48546218c5b93b5b30252e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:43.158053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-804d1143-d021-46dc-bf35-cd6e8768b162 None None] MFA Rules not processed for user `b4bf96fbc0fb4efca7921e4ec2b279ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:41:43.158955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b6a135ea-45df-4602-877f-f267a84de532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.159170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-804d1143-d021-46dc-bf35-cd6e8768b162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.225491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1063/2103] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:41:43.228447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1041/2104] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:41:43 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:41:43.236234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d1143-d021-46dc-bf35-cd6e8768b162 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.237782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-804d1143-d021-46dc-bf35-cd6e8768b162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.239668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a135ea-45df-4602-877f-f267a84de532 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.241133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b6a135ea-45df-4602-877f-f267a84de532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:43.274656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:43.296046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d1143-d021-46dc-bf35-cd6e8768b162 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.299522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a135ea-45df-4602-877f-f267a84de532 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.299748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69a998-636d-404a-821b-52ab27c5e881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.300400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a998-636d-404a-821b-52ab27c5e881 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.300680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a998-636d-404a-821b-52ab27c5e881 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.300960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69a998-636d-404a-821b-52ab27c5e881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.303345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.304000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.304284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.304559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.309464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69a998-636d-404a-821b-52ab27c5e881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.310933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69a998-636d-404a-821b-52ab27c5e881 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.313492 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.314975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.320072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1064/2105] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:43.324857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1042/2106] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:41:43.417927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69a998-636d-404a-821b-52ab27c5e881 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:43.428944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69a998-636d-404a-821b-52ab27c5e881 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:43.433666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506242-9cf2-40a6-a9e5-7a0a8b679a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:43.434382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506242-9cf2-40a6-a9e5-7a0a8b679a50 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:43.434817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506242-9cf2-40a6-a9e5-7a0a8b679a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:43.435056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506242-9cf2-40a6-a9e5-7a0a8b679a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:43.502730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:43.527168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e506242-9cf2-40a6-a9e5-7a0a8b679a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:43.528839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e506242-9cf2-40a6-a9e5-7a0a8b679a50 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:43.539538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1065/2107] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:43 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:44.751056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:41:44.752592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:44.827847 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503b800-8d8b-40b4-a476-a56a8e650e04 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:41:44.832966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846643fa-f089-41dd-a561-c9e72163189e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:41:44.833617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846643fa-f089-41dd-a561-c9e72163189e service placement] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:41:44.833960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846643fa-f089-41dd-a561-c9e72163189e service placement] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:41:44.834293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846643fa-f089-41dd-a561-c9e72163189e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:41:44.836154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-846643fa-f089-41dd-a561-c9e72163189e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:41:44.847793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846643fa-f089-41dd-a561-c9e72163189e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:41:44.849388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846643fa-f089-41dd-a561-c9e72163189e service placement] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:41:44.866283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1043/2108] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:41:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:41:53.535235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=8 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:41:54.855565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=44 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:16.219386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506242-9cf2-40a6-a9e5-7a0a8b679a50 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:16.388878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506242-9cf2-40a6-a9e5-7a0a8b679a50 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:16.396417 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:16.397367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:16.397667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:16.397977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] PATH_INFO: `/v3/users/b4bf96fbc0fb4efca7921e4ec2b279ec` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:16.399255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4bf96fbc0fb4efca7921e4ec2b279ec)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:16.401387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:16.476299 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4bf96fbc0fb4efca7921e4ec2b279ec'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:16.489480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4bf96fbc0fb4efca7921e4ec2b279ec'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:16.490642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4bf96fbc0fb4efca7921e4ec2b279ec'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:16.500838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4bf96fbc0fb4efca7921e4ec2b279ec'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:16.518905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4bf96fbc0fb4efca7921e4ec2b279ec'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:16.527591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1066/2109] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:16 2022] DELETE /identity/v3/users/b4bf96fbc0fb4efca7921e4ec2b279ec => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:16.532060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b489f-8522-43be-b3c9-1d9ea94c9f03 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:16.532599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b489f-8522-43be-b3c9-1d9ea94c9f03 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:16.532697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b489f-8522-43be-b3c9-1d9ea94c9f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:16.562393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-533b489f-8522-43be-b3c9-1d9ea94c9f03 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:16.564442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-533b489f-8522-43be-b3c9-1d9ea94c9f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:16.784165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1044/2110] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:16.791753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:16.793619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:16.959902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6d897-09f7-4f77-83e3-948af5bc6272 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:16.970106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03b700-0c9c-4e0e-9f0a-50937002d565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:16.972019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b700-0c9c-4e0e-9f0a-50937002d565 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:16.973804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b700-0c9c-4e0e-9f0a-50937002d565 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:16.973804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03b700-0c9c-4e0e-9f0a-50937002d565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:16.997770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b700-0c9c-4e0e-9f0a-50937002d565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:17.002232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03b700-0c9c-4e0e-9f0a-50937002d565 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:17.022739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1067/2111] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:17.798156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b489f-8522-43be-b3c9-1d9ea94c9f03 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:17.799895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-533b489f-8522-43be-b3c9-1d9ea94c9f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:17.819536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b489f-8522-43be-b3c9-1d9ea94c9f03 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:17.826810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:17.827706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:17.827986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:17.828458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] PATH_INFO: `/v3/projects/bfa295b828cf4aaaab2ee5bb2f14d5f6` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:17.829666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa295b828cf4aaaab2ee5bb2f14d5f6)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:17.831763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:17.881661 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa295b828cf4aaaab2ee5bb2f14d5f6', 'request_id': 'req-3e5530e2-5d41-42af-b90f-0656ffa72cf5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:17.891096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa295b828cf4aaaab2ee5bb2f14d5f6', 'request_id': 'req-3e5530e2-5d41-42af-b90f-0656ffa72cf5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:17.897713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa295b828cf4aaaab2ee5bb2f14d5f6', 'request_id': 'req-3e5530e2-5d41-42af-b90f-0656ffa72cf5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:17.911926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] The token cache is being invalidate because project bfa295b828cf4aaaab2ee5bb2f14d5f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:17.912219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:17.912893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e5530e2-5d41-42af-b90f-0656ffa72cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:17.914575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1045/2112] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:17 2022] DELETE /identity/v3/projects/bfa295b828cf4aaaab2ee5bb2f14d5f6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:17.919457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08915eb-8fa6-400a-8d64-d9a7aa123bea None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:17.920128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08915eb-8fa6-400a-8d64-d9a7aa123bea None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:17.920128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08915eb-8fa6-400a-8d64-d9a7aa123bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:17.942887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b08915eb-8fa6-400a-8d64-d9a7aa123bea None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:17.944244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b08915eb-8fa6-400a-8d64-d9a7aa123bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:17.963430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:18.009975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1068/2113] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:18.017645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9158668-2ac8-43c3-9d36-745d4f87a932 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.017978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9158668-2ac8-43c3-9d36-745d4f87a932 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.018279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9158668-2ac8-43c3-9d36-745d4f87a932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.037384 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a9158668-2ac8-43c3-9d36-745d4f87a932 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:18.038723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a9158668-2ac8-43c3-9d36-745d4f87a932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:18.053240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1046/2114] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:18.059301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08915eb-8fa6-400a-8d64-d9a7aa123bea None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.073796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08915eb-8fa6-400a-8d64-d9a7aa123bea None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.079986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.080798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.081170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.081504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.082340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:42:18.082749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.084780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.101318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1069/2115] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:42:18.104209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9158668-2ac8-43c3-9d36-745d4f87a932 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.113622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9158668-2ac8-43c3-9d36-745d4f87a932 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.118894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6195b4-b956-4e31-b7b6-038f276252de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.119763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6195b4-b956-4e31-b7b6-038f276252de admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.120218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6195b4-b956-4e31-b7b6-038f276252de admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.120764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6195b4-b956-4e31-b7b6-038f276252de admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.121626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6195b4-b956-4e31-b7b6-038f276252de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.124257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6195b4-b956-4e31-b7b6-038f276252de admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.169170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1047/2116] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:42:18 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:18.173446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.185244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc33b0-d6bf-414a-bbf5-31f5269ac071 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.260726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d06bf-7a8e-4565-bb1a-081d1dd12ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.261412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d06bf-7a8e-4565-bb1a-081d1dd12ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.261677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d06bf-7a8e-4565-bb1a-081d1dd12ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.261990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d06bf-7a8e-4565-bb1a-081d1dd12ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.262678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d06bf-7a8e-4565-bb1a-081d1dd12ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.264685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d06bf-7a8e-4565-bb1a-081d1dd12ffa admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.292950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1070/2117] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:42:18 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:18.296744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6195b4-b956-4e31-b7b6-038f276252de admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.307767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6195b4-b956-4e31-b7b6-038f276252de admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.313054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a2d2e-e4e7-4d6e-8800-2d492dc440d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.313813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a2d2e-e4e7-4d6e-8800-2d492dc440d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.314138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a2d2e-e4e7-4d6e-8800-2d492dc440d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.314411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a2d2e-e4e7-4d6e-8800-2d492dc440d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.315218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a2d2e-e4e7-4d6e-8800-2d492dc440d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.316789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a2d2e-e4e7-4d6e-8800-2d492dc440d5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.327766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1048/2118] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:18.332330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d06bf-7a8e-4565-bb1a-081d1dd12ffa admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.345591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d06bf-7a8e-4565-bb1a-081d1dd12ffa admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.351814 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.352507 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.352797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.353491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.354283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.356474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.370128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1071/2119] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:18.373739 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a2d2e-e4e7-4d6e-8800-2d492dc440d5 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.383667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.385618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:18.386352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a2d2e-e4e7-4d6e-8800-2d492dc440d5 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.391853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec7e82-b496-4d7b-bb28-09f295d7e082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.392750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec7e82-b496-4d7b-bb28-09f295d7e082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.393275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec7e82-b496-4d7b-bb28-09f295d7e082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.393605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec7e82-b496-4d7b-bb28-09f295d7e082 admin admin] PATH_INFO: `/v3/projects/05a162e9ed364fdfb05ebd39d331054c/users/998b17638dcf4a38a9d2da40baf7c108/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.404948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f683a-9ae9-4053-9a78-3f3659af9295 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.410459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.411492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.411861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.412234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] PATH_INFO: `/v3/users/f1e662cab4cd446f997c74a690d40454` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.412560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec7e82-b496-4d7b-bb28-09f295d7e082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a162e9ed364fdfb05ebd39d331054c, user_id=998b17638dcf4a38a9d2da40baf7c108, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.413808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e662cab4cd446f997c74a690d40454)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.415295 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec7e82-b496-4d7b-bb28-09f295d7e082 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.416315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.432250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1049/2120] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:42:18 2022] PUT /identity/v3/projects/05a162e9ed364fdfb05ebd39d331054c/users/998b17638dcf4a38a9d2da40baf7c108/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:18.443620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a057c-3f4a-4499-bf30-6c8d68e7c241 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.443968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a057c-3f4a-4499-bf30-6c8d68e7c241 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.444301 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a057c-3f4a-4499-bf30-6c8d68e7c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.475899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ce6a057c-3f4a-4499-bf30-6c8d68e7c241 None None] MFA Rules not processed for user `998b17638dcf4a38a9d2da40baf7c108`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:18.477250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ce6a057c-3f4a-4499-bf30-6c8d68e7c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:18.483826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e662cab4cd446f997c74a690d40454'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:18.486536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:18.493484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e662cab4cd446f997c74a690d40454'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:18.494221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e662cab4cd446f997c74a690d40454'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:18.503662 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e662cab4cd446f997c74a690d40454'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:18.520914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-731c5661-f4cc-466c-82c2-67c842efa9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e662cab4cd446f997c74a690d40454'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:18.523634 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:18.528951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1072/2121] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:18 2022] DELETE /identity/v3/users/f1e662cab4cd446f997c74a690d40454 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:18.533757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77523c-ac9c-4964-aa0c-b5ea123da41c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.534657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77523c-ac9c-4964-aa0c-b5ea123da41c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.535689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77523c-ac9c-4964-aa0c-b5ea123da41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.555487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-7c77523c-ac9c-4964-aa0c-b5ea123da41c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:18.555895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1050/2122] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:42:18.556632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7c77523c-ac9c-4964-aa0c-b5ea123da41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:18.568243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a057c-3f4a-4499-bf30-6c8d68e7c241 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.569642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ce6a057c-3f4a-4499-bf30-6c8d68e7c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:18.621693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1073/2123] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:42:18.631698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77523c-ac9c-4964-aa0c-b5ea123da41c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:18.632343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a057c-3f4a-4499-bf30-6c8d68e7c241 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.633322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7c77523c-ac9c-4964-aa0c-b5ea123da41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:18.685240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c626f5-987e-4e41-afae-b824e3d77bf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.686106 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c626f5-987e-4e41-afae-b824e3d77bf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.686438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c626f5-987e-4e41-afae-b824e3d77bf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.686765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c626f5-987e-4e41-afae-b824e3d77bf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.709164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77523c-ac9c-4964-aa0c-b5ea123da41c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:18.712787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:18.713438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:18.713718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:18.714036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:18.723279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.724724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.734500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1074/2124] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:42:18.747797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c626f5-987e-4e41-afae-b824e3d77bf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:18.749247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c626f5-987e-4e41-afae-b824e3d77bf9 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:18.758544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1051/2125] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:19.063272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:19.065057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:19.080577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732843a-10a6-4250-8440-886b7fab0e41 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:19.086425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:19.086981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:19.087262 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:19.087539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] PATH_INFO: `/v3/projects/488c24aa331a4fec8c72b71089f24a44` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:19.088776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488c24aa331a4fec8c72b71089f24a44)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:19.090751 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:19.156178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488c24aa331a4fec8c72b71089f24a44', 'request_id': 'req-edbcb1f1-72f9-4bc3-970a-637619cd92b5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.168828 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488c24aa331a4fec8c72b71089f24a44', 'request_id': 'req-edbcb1f1-72f9-4bc3-970a-637619cd92b5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.176105 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488c24aa331a4fec8c72b71089f24a44', 'request_id': 'req-edbcb1f1-72f9-4bc3-970a-637619cd92b5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.188629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] The token cache is being invalidate because project 488c24aa331a4fec8c72b71089f24a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:19.188965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.189589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.194542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1075/2126] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:19 2022] DELETE /identity/v3/projects/488c24aa331a4fec8c72b71089f24a44 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:19.195641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c626f5-987e-4e41-afae-b824e3d77bf9 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:19.221937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c626f5-987e-4e41-afae-b824e3d77bf9 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:19.244592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:19.338194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:19.339219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:19.339509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:19.339792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] PATH_INFO: `/v3/users/30d80bfec48546218c5b93b5b30252e0` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:19.341376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d80bfec48546218c5b93b5b30252e0)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:19.343918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:19.412175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d80bfec48546218c5b93b5b30252e0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.412858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d80bfec48546218c5b93b5b30252e0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.422409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d80bfec48546218c5b93b5b30252e0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.429563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d80bfec48546218c5b93b5b30252e0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.442966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-20c5ed2b-2ca5-4e24-89ac-a86a8843ea28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d80bfec48546218c5b93b5b30252e0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.449552 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1052/2127] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:19 2022] DELETE /identity/v3/users/30d80bfec48546218c5b93b5b30252e0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:42:19.731010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:19.732552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:19.745339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcb1f1-72f9-4bc3-970a-637619cd92b5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:19.770884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:19.804897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:19.805731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:19.806049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:19.806346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] PATH_INFO: `/v3/projects/b434407b24ce4ed3a527c486ec873de8` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:19.807613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b434407b24ce4ed3a527c486ec873de8)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:19.809580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:19.866738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b434407b24ce4ed3a527c486ec873de8', 'request_id': 'req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.876939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b434407b24ce4ed3a527c486ec873de8', 'request_id': 'req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.885655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b434407b24ce4ed3a527c486ec873de8', 'request_id': 'req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.899402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] The token cache is being invalidate because project b434407b24ce4ed3a527c486ec873de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:19.899690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.900344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-7c578ab6-626c-4163-8a9c-dbecb5d6ba30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:19.901971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1076/2128] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:19 2022] DELETE /identity/v3/projects/b434407b24ce4ed3a527c486ec873de8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:19.906944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d00fb-0de6-455c-8dc8-cf2cb95155b7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:19.907230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d00fb-0de6-455c-8dc8-cf2cb95155b7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:19.907502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d00fb-0de6-455c-8dc8-cf2cb95155b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:19.926524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1b6d00fb-0de6-455c-8dc8-cf2cb95155b7 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:19.927854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1b6d00fb-0de6-455c-8dc8-cf2cb95155b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:19.988143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1053/2129] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:19.996289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67457-d959-45ef-b29d-ec560b8f0f18 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:19.996579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67457-d959-45ef-b29d-ec560b8f0f18 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:19.996860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea67457-d959-45ef-b29d-ec560b8f0f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.016696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1ea67457-d959-45ef-b29d-ec560b8f0f18 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:20.017991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1ea67457-d959-45ef-b29d-ec560b8f0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:20.027545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1077/2130] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:20.031938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d00fb-0de6-455c-8dc8-cf2cb95155b7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.042970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d00fb-0de6-455c-8dc8-cf2cb95155b7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.047750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.048432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.048713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.048979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.049770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:42:20.050101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.051700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.064931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1054/2131] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:42:20.069436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea67457-d959-45ef-b29d-ec560b8f0f18 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.079344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea67457-d959-45ef-b29d-ec560b8f0f18 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.086253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78553f4-8b8a-403c-a22a-ce9399b25612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.087175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78553f4-8b8a-403c-a22a-ce9399b25612 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.087570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78553f4-8b8a-403c-a22a-ce9399b25612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.087924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78553f4-8b8a-403c-a22a-ce9399b25612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.089008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78553f4-8b8a-403c-a22a-ce9399b25612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.091707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78553f4-8b8a-403c-a22a-ce9399b25612 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.129321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1078/2132] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:42:20 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:20.133678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.144065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c0bae-ad46-4a59-89d9-d2cc9a052489 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.169902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:20.204087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c47d33-2060-4d93-b3de-b5cf08240e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.204764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47d33-2060-4d93-b3de-b5cf08240e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.205010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47d33-2060-4d93-b3de-b5cf08240e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.205284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c47d33-2060-4d93-b3de-b5cf08240e1f admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.205992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c47d33-2060-4d93-b3de-b5cf08240e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.207944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c47d33-2060-4d93-b3de-b5cf08240e1f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.228680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1055/2133] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:42:20 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:20.232818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78553f4-8b8a-403c-a22a-ce9399b25612 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.243357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78553f4-8b8a-403c-a22a-ce9399b25612 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.248856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411fe0-cb14-45e5-8a9d-5455139df4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.249514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411fe0-cb14-45e5-8a9d-5455139df4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.249790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411fe0-cb14-45e5-8a9d-5455139df4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.250080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411fe0-cb14-45e5-8a9d-5455139df4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.250825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73411fe0-cb14-45e5-8a9d-5455139df4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.252489 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73411fe0-cb14-45e5-8a9d-5455139df4a9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.263594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1079/2134] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:20.267717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c47d33-2060-4d93-b3de-b5cf08240e1f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.278780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c47d33-2060-4d93-b3de-b5cf08240e1f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.285241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05b573-6a90-41d0-b66d-8d0e0f95aca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.285889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b573-6a90-41d0-b66d-8d0e0f95aca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.286195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b573-6a90-41d0-b66d-8d0e0f95aca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.286500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05b573-6a90-41d0-b66d-8d0e0f95aca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.287417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05b573-6a90-41d0-b66d-8d0e0f95aca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.289052 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05b573-6a90-41d0-b66d-8d0e0f95aca9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.300200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1056/2135] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:20.304867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411fe0-cb14-45e5-8a9d-5455139df4a9 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.323154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411fe0-cb14-45e5-8a9d-5455139df4a9 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.328771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98f3e-5455-453a-beb0-5c979e6b5435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.329772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98f3e-5455-453a-beb0-5c979e6b5435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.330287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98f3e-5455-453a-beb0-5c979e6b5435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.330395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba98f3e-5455-453a-beb0-5c979e6b5435 admin admin] PATH_INFO: `/v3/projects/a63e7f584fa54a3d97d9d08722c2b4a8/users/ae4f4a7303a44f7997c3387000edf95e/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.346617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba98f3e-5455-453a-beb0-5c979e6b5435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63e7f584fa54a3d97d9d08722c2b4a8, user_id=ae4f4a7303a44f7997c3387000edf95e, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.349274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba98f3e-5455-453a-beb0-5c979e6b5435 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.363655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1080/2136] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:42:20 2022] PUT /identity/v3/projects/a63e7f584fa54a3d97d9d08722c2b4a8/users/ae4f4a7303a44f7997c3387000edf95e/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:20.376424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3e59-5e93-4ca6-983b-9122652138a7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.376727 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3e59-5e93-4ca6-983b-9122652138a7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.377028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade3e59-5e93-4ca6-983b-9122652138a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.403302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8ade3e59-5e93-4ca6-983b-9122652138a7 None None] MFA Rules not processed for user `ae4f4a7303a44f7997c3387000edf95e`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:20.404490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8ade3e59-5e93-4ca6-983b-9122652138a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:20.472691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1057/2137] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:20.477599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98f3e-5455-453a-beb0-5c979e6b5435 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.550013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:20.560952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba98f3e-5455-453a-beb0-5c979e6b5435 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.566647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8b86-a733-4919-8e58-723771b83866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.567255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8b86-a733-4919-8e58-723771b83866 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.567538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8b86-a733-4919-8e58-723771b83866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.567817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e8b86-a733-4919-8e58-723771b83866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.568577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e8b86-a733-4919-8e58-723771b83866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.570542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e8b86-a733-4919-8e58-723771b83866 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.598332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1081/2138] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:42:20 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:20.602574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3e59-5e93-4ca6-983b-9122652138a7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.615688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade3e59-5e93-4ca6-983b-9122652138a7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.677021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca0c2-79a6-45a1-b9f9-a295a1c22922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.677712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca0c2-79a6-45a1-b9f9-a295a1c22922 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.678087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca0c2-79a6-45a1-b9f9-a295a1c22922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.678313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fca0c2-79a6-45a1-b9f9-a295a1c22922 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.679016 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fca0c2-79a6-45a1-b9f9-a295a1c22922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.682913 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fca0c2-79a6-45a1-b9f9-a295a1c22922 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.707613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1058/2139] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:42:20 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:20.711677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8b86-a733-4919-8e58-723771b83866 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.722250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e8b86-a733-4919-8e58-723771b83866 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.726825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469c3a7-4071-4cb7-81dd-d0b14e7c0b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.727489 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469c3a7-4071-4cb7-81dd-d0b14e7c0b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.727774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469c3a7-4071-4cb7-81dd-d0b14e7c0b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.728054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469c3a7-4071-4cb7-81dd-d0b14e7c0b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.728789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469c3a7-4071-4cb7-81dd-d0b14e7c0b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.730444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469c3a7-4071-4cb7-81dd-d0b14e7c0b97 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.741251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1082/2140] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:20.745459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca0c2-79a6-45a1-b9f9-a295a1c22922 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.756178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fca0c2-79a6-45a1-b9f9-a295a1c22922 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.761348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7970d-ca0f-4666-a5c7-f9912381f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.762284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7970d-ca0f-4666-a5c7-f9912381f910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.762555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7970d-ca0f-4666-a5c7-f9912381f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.762829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7970d-ca0f-4666-a5c7-f9912381f910 admin admin] PATH_INFO: `/v3/projects/83b1411986104dba9ca3d3e2b7270a24/users/e63ae31eb117492db3d280549c816222/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.779759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7970d-ca0f-4666-a5c7-f9912381f910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b1411986104dba9ca3d3e2b7270a24, user_id=e63ae31eb117492db3d280549c816222, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.782582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7970d-ca0f-4666-a5c7-f9912381f910 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.794233 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:20.799748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1059/2141] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:42:20 2022] PUT /identity/v3/projects/83b1411986104dba9ca3d3e2b7270a24/users/e63ae31eb117492db3d280549c816222/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:20.804098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469c3a7-4071-4cb7-81dd-d0b14e7c0b97 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.814356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469c3a7-4071-4cb7-81dd-d0b14e7c0b97 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.872552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089c059-3d8c-406a-9bfb-fce42ff14768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.873140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c059-3d8c-406a-9bfb-fce42ff14768 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.873430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c059-3d8c-406a-9bfb-fce42ff14768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.873707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089c059-3d8c-406a-9bfb-fce42ff14768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.874472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089c059-3d8c-406a-9bfb-fce42ff14768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.876067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089c059-3d8c-406a-9bfb-fce42ff14768 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.886337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1083/2142] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:20.891363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7970d-ca0f-4666-a5c7-f9912381f910 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:20.903643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7970d-ca0f-4666-a5c7-f9912381f910 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:20.908784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:20.909690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.909988 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.910291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] PATH_INFO: `/v3/projects/83b1411986104dba9ca3d3e2b7270a24/users/e63ae31eb117492db3d280549c816222/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.912478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b1411986104dba9ca3d3e2b7270a24, user_id=e63ae31eb117492db3d280549c816222, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:20.915224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:20.926753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1060/2143] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:42:20 2022] PUT /identity/v3/projects/83b1411986104dba9ca3d3e2b7270a24/users/e63ae31eb117492db3d280549c816222/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:20.937656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025775b-d2a3-47f5-876f-30429781f352 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:20.937980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025775b-d2a3-47f5-876f-30429781f352 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:20.938265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025775b-d2a3-47f5-876f-30429781f352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:20.964868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-6025775b-d2a3-47f5-876f-30429781f352 None None] MFA Rules not processed for user `e63ae31eb117492db3d280549c816222`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:20.966119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6025775b-d2a3-47f5-876f-30429781f352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:21.034595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1084/2144] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:21.052117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:21.053968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:21.113728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97357bee-f3fb-43ba-ad6e-1a64f438edb5 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:21.117878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f273972-38c5-42cf-9aae-b61ccb423ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:21.118548 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273972-38c5-42cf-9aae-b61ccb423ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:21.118823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273972-38c5-42cf-9aae-b61ccb423ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:21.119097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f273972-38c5-42cf-9aae-b61ccb423ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:21.129500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f273972-38c5-42cf-9aae-b61ccb423ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:21.131084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f273972-38c5-42cf-9aae-b61ccb423ba2 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:21.140532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1061/2145] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:21.473743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025775b-d2a3-47f5-876f-30429781f352 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:21.483828 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025775b-d2a3-47f5-876f-30429781f352 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:21.489462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ae31eb117492db3d280549c816222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1411986104dba9ca3d3e2b7270a24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:21.490157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:21.490443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:21.490724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:21.492543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:42:21.492543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:21.493373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:21.505509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1085/2146] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:42:21.510240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f273972-38c5-42cf-9aae-b61ccb423ba2 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:21.520114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f273972-38c5-42cf-9aae-b61ccb423ba2 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:21.525273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6fe24-a8f3-4a91-8916-04df5cf82191 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ae31eb117492db3d280549c816222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1411986104dba9ca3d3e2b7270a24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:21.525932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6fe24-a8f3-4a91-8916-04df5cf82191 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:21.526254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6fe24-a8f3-4a91-8916-04df5cf82191 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:21.526533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6fe24-a8f3-4a91-8916-04df5cf82191 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:21.527236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6fe24-a8f3-4a91-8916-04df5cf82191 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:21.529146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6fe24-a8f3-4a91-8916-04df5cf82191 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:21.563317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1062/2147] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:42:21 2022] POST /identity/v3/projects => generated 354 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:21.567210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:21.577973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf94e52-d3f5-49ee-a2d8-4a4ce5166aa5 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:21.609446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:21.635674 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ae31eb117492db3d280549c816222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1411986104dba9ca3d3e2b7270a24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:21.636334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:21.636649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:21.636933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:21.637665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:42:21.638041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:21.639627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:21.651153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1086/2148] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:42:21.688792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6fe24-a8f3-4a91-8916-04df5cf82191 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:21.700185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6fe24-a8f3-4a91-8916-04df5cf82191 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:21.706128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e63ae31eb117492db3d280549c816222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1411986104dba9ca3d3e2b7270a24', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:21.707299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:21.707588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:21.707832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] PATH_INFO: `/v3/projects/46445db8bf714331afccc8eb93910d72` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:21.709254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Authorizing `identity:delete_project(project_id=46445db8bf714331afccc8eb93910d72)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:21.711080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:21.763707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46445db8bf714331afccc8eb93910d72', 'request_id': 'req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.773018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46445db8bf714331afccc8eb93910d72', 'request_id': 'req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.779892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46445db8bf714331afccc8eb93910d72', 'request_id': 'req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.791716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] The token cache is being invalidate because project 46445db8bf714331afccc8eb93910d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:21.792008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.792755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4d1d4f26-1cd0-42b1-8e88-204e72153ac0 tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:21.794482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1063/2149] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:21 2022] DELETE /identity/v3/projects/46445db8bf714331afccc8eb93910d72 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:21.992921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:21.994725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:22.060827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2edd1-d4da-4877-b6cb-6a7c3158ca5a tempest-VolumeQuotaClassesTest-964680193 tempest-VolumeQuotaClassesTest-964680193-project-admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:22.118906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:22.119792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:22.120080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:22.120359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] PATH_INFO: `/v3/users/ae4f4a7303a44f7997c3387000edf95e` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:22.121580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4f4a7303a44f7997c3387000edf95e)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:22.123542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:22.175894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4f4a7303a44f7997c3387000edf95e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.183531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4f4a7303a44f7997c3387000edf95e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.184139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4f4a7303a44f7997c3387000edf95e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.190938 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4f4a7303a44f7997c3387000edf95e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.201905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:22.203115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4f4a7303a44f7997c3387000edf95e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.209543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1087/2150] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:21 2022] DELETE /identity/v3/users/ae4f4a7303a44f7997c3387000edf95e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:22.214424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4f412-efa9-4714-ab14-8de9376710d2 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:22.214784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4f412-efa9-4714-ab14-8de9376710d2 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:22.215065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4f412-efa9-4714-ab14-8de9376710d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:22.234560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d5f4f412-efa9-4714-ab14-8de9376710d2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:22.235736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d5f4f412-efa9-4714-ab14-8de9376710d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:22.281019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:22.297454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1064/2151] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:22.307682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:22.309294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:22.373588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f86b5-c120-4fe7-8118-73ffced282d5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:22.377920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d1db-57b7-41e1-9e88-09c879f44606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:22.378597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d1db-57b7-41e1-9e88-09c879f44606 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:22.378885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d1db-57b7-41e1-9e88-09c879f44606 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:22.379161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671d1db-57b7-41e1-9e88-09c879f44606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:22.389401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671d1db-57b7-41e1-9e88-09c879f44606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:22.390898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671d1db-57b7-41e1-9e88-09c879f44606 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:22.401836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1088/2152] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:22.680512 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4f412-efa9-4714-ab14-8de9376710d2 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:22.682187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d5f4f412-efa9-4714-ab14-8de9376710d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:22.696962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4f412-efa9-4714-ab14-8de9376710d2 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:22.702273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:22.703154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:22.703472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:22.703925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] PATH_INFO: `/v3/projects/a63e7f584fa54a3d97d9d08722c2b4a8` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:22.705062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63e7f584fa54a3d97d9d08722c2b4a8)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:22.707306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:22.755175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63e7f584fa54a3d97d9d08722c2b4a8', 'request_id': 'req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.764118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63e7f584fa54a3d97d9d08722c2b4a8', 'request_id': 'req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.770401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63e7f584fa54a3d97d9d08722c2b4a8', 'request_id': 'req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.781407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] The token cache is being invalidate because project a63e7f584fa54a3d97d9d08722c2b4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:22.781772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.782436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.784000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1065/2153] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:22 2022] DELETE /identity/v3/projects/a63e7f584fa54a3d97d9d08722c2b4a8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:22.788215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d1db-57b7-41e1-9e88-09c879f44606 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:22.798197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671d1db-57b7-41e1-9e88-09c879f44606 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:22.864614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:22.865487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:22.865771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:22.866080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] PATH_INFO: `/v3/users/e63ae31eb117492db3d280549c816222` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:22.867333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63ae31eb117492db3d280549c816222)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:22.869270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:22.921501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63ae31eb117492db3d280549c816222'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.931729 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63ae31eb117492db3d280549c816222'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.932387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63ae31eb117492db3d280549c816222'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.940149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63ae31eb117492db3d280549c816222'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.952837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-69bc7313-3bf7-4cb3-83ec-ecbe4d3a0722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63ae31eb117492db3d280549c816222'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:22.960299 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1089/2154] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:22 2022] DELETE /identity/v3/users/e63ae31eb117492db3d280549c816222 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:23.244376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:23.246149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:23.259832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbd749-8c73-4b0a-a254-a2b3d92a22aa admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:23.323658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:23.324451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.324735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.325010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] PATH_INFO: `/v3/projects/83b1411986104dba9ca3d3e2b7270a24` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.326215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b1411986104dba9ca3d3e2b7270a24)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:23.328160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:23.384328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b1411986104dba9ca3d3e2b7270a24', 'request_id': 'req-e5c10fec-70a7-4692-8faa-6edc2a382e11'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:23.392933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b1411986104dba9ca3d3e2b7270a24', 'request_id': 'req-e5c10fec-70a7-4692-8faa-6edc2a382e11'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:23.399062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b1411986104dba9ca3d3e2b7270a24', 'request_id': 'req-e5c10fec-70a7-4692-8faa-6edc2a382e11'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:23.410291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] The token cache is being invalidate because project 83b1411986104dba9ca3d3e2b7270a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:23.410578 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:23.411276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c10fec-70a7-4692-8faa-6edc2a382e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:23.412944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1066/2155] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:23 2022] DELETE /identity/v3/projects/83b1411986104dba9ca3d3e2b7270a24 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:23.418543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24a283-98af-4e05-a11b-65ebb13ee977 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.418847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24a283-98af-4e05-a11b-65ebb13ee977 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.419127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24a283-98af-4e05-a11b-65ebb13ee977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.438636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8f24a283-98af-4e05-a11b-65ebb13ee977 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:23.439955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8f24a283-98af-4e05-a11b-65ebb13ee977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:23.453182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:23.510353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1090/2156] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:23.520282 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8a066-a0f1-4495-94fd-dffb4686cc0e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.520601 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8a066-a0f1-4495-94fd-dffb4686cc0e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.520883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8a066-a0f1-4495-94fd-dffb4686cc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.529313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:23.541487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-97f8a066-a0f1-4495-94fd-dffb4686cc0e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:23.543268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-97f8a066-a0f1-4495-94fd-dffb4686cc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:23.552001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1067/2157] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:23.556564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24a283-98af-4e05-a11b-65ebb13ee977 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:23.567096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24a283-98af-4e05-a11b-65ebb13ee977 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:23.573297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:23.574076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.574324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.574627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.575365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:42:23.575675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:23.577323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:23.589387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1091/2158] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:42:23.593763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8a066-a0f1-4495-94fd-dffb4686cc0e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:23.603162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8a066-a0f1-4495-94fd-dffb4686cc0e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:23.608412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73585d6d-4290-4c1e-810e-a6b5734ea907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:23.609072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73585d6d-4290-4c1e-810e-a6b5734ea907 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.609352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73585d6d-4290-4c1e-810e-a6b5734ea907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.609638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73585d6d-4290-4c1e-810e-a6b5734ea907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.610374 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73585d6d-4290-4c1e-810e-a6b5734ea907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:23.612552 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73585d6d-4290-4c1e-810e-a6b5734ea907 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:23.649013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1068/2159] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:42:23 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:23.650622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:23.660716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f34ee-ec82-49d7-900f-63119a928ad6 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:23.721180 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c0872-28fb-4aa2-bcc2-e33c51c2b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:23.721867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0872-28fb-4aa2-bcc2-e33c51c2b736 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.722182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0872-28fb-4aa2-bcc2-e33c51c2b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.722461 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0872-28fb-4aa2-bcc2-e33c51c2b736 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.723166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c0872-28fb-4aa2-bcc2-e33c51c2b736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:23.725107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c0872-28fb-4aa2-bcc2-e33c51c2b736 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:23.746660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1092/2160] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:42:23 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:23.750508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73585d6d-4290-4c1e-810e-a6b5734ea907 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:23.761479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73585d6d-4290-4c1e-810e-a6b5734ea907 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:23.766634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08bfbe-8df2-45e7-b5a7-e7c850326a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:23.767320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08bfbe-8df2-45e7-b5a7-e7c850326a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.767598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08bfbe-8df2-45e7-b5a7-e7c850326a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.767873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08bfbe-8df2-45e7-b5a7-e7c850326a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.768656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08bfbe-8df2-45e7-b5a7-e7c850326a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:23.771447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08bfbe-8df2-45e7-b5a7-e7c850326a35 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:23.783957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1069/2161] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:23.789048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c0872-28fb-4aa2-bcc2-e33c51c2b736 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:23.800517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c0872-28fb-4aa2-bcc2-e33c51c2b736 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:23.805581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ac79e-b7f6-4daf-94bb-7bc9dedbc81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:23.806281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ac79e-b7f6-4daf-94bb-7bc9dedbc81f admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.806567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ac79e-b7f6-4daf-94bb-7bc9dedbc81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.806865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ac79e-b7f6-4daf-94bb-7bc9dedbc81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.807600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ac79e-b7f6-4daf-94bb-7bc9dedbc81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:23.809209 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ac79e-b7f6-4daf-94bb-7bc9dedbc81f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:23.821646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1093/2162] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:23.826289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08bfbe-8df2-45e7-b5a7-e7c850326a35 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:23.836568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08bfbe-8df2-45e7-b5a7-e7c850326a35 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:23.841402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:23.842294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.842573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.842850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] PATH_INFO: `/v3/projects/541105c56e204565a3805cac6f2d1a16/users/3960683257b04ed0b074d63c8b76b590/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.859048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] RBAC: Authorizing `identity:create_grant(project_id=541105c56e204565a3805cac6f2d1a16, user_id=3960683257b04ed0b074d63c8b76b590, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:23.861740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:23.876821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1070/2163] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:42:23 2022] PUT /identity/v3/projects/541105c56e204565a3805cac6f2d1a16/users/3960683257b04ed0b074d63c8b76b590/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:42:23.888436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368483-d7b7-4c86-bf96-1ccacf45defb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:23.888745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368483-d7b7-4c86-bf96-1ccacf45defb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:23.889019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368483-d7b7-4c86-bf96-1ccacf45defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:23.915407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-0a368483-d7b7-4c86-bf96-1ccacf45defb None None] MFA Rules not processed for user `3960683257b04ed0b074d63c8b76b590`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:23.916640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0a368483-d7b7-4c86-bf96-1ccacf45defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:23.992885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1094/2164] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:24.006110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:24.008072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:24.093996 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd6edc-002b-4576-acc6-dcce13ef033d admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:24.097770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21cb39-7ac8-437b-81e9-df875a0651a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1a1889e2fb436a86c5e68bf9f1e608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:24.098460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21cb39-7ac8-437b-81e9-df875a0651a4 service glance] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:24.098742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21cb39-7ac8-437b-81e9-df875a0651a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:24.099018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21cb39-7ac8-437b-81e9-df875a0651a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:24.109810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21cb39-7ac8-437b-81e9-df875a0651a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:24.111278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21cb39-7ac8-437b-81e9-df875a0651a4 service glance] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:24.120588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1071/2165] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:28.002996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a368483-d7b7-4c86-bf96-1ccacf45defb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:28.004944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0a368483-d7b7-4c86-bf96-1ccacf45defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:28.019687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:28.074021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a368483-d7b7-4c86-bf96-1ccacf45defb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:28.078760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:28.079656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:28.080792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:28.081083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] PATH_INFO: `/v3/users/998b17638dcf4a38a9d2da40baf7c108` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:28.082673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=998b17638dcf4a38a9d2da40baf7c108)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:28.084619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:28.135871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998b17638dcf4a38a9d2da40baf7c108'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.144223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998b17638dcf4a38a9d2da40baf7c108'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.144931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998b17638dcf4a38a9d2da40baf7c108'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.152421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998b17638dcf4a38a9d2da40baf7c108'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.166560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998b17638dcf4a38a9d2da40baf7c108'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.173483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1095/2166] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:28 2022] DELETE /identity/v3/users/998b17638dcf4a38a9d2da40baf7c108 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:42:28.178534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9c18-2998-490d-88c1-7fb050d67c6a None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:28.179106 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9c18-2998-490d-88c1-7fb050d67c6a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:28.179106 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d9c18-2998-490d-88c1-7fb050d67c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:28.201453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-be7d9c18-2998-490d-88c1-7fb050d67c6a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:28.202728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-be7d9c18-2998-490d-88c1-7fb050d67c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:28.267010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1072/2167] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:28.277299 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:28.278926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:28.342548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a61f3-ad49-4022-a34b-3742717c2aea admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:28.346738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f7447-5da2-45ef-8ac9-016fae73a625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:28.347396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f7447-5da2-45ef-8ac9-016fae73a625 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:28.347684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f7447-5da2-45ef-8ac9-016fae73a625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:28.347995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f7447-5da2-45ef-8ac9-016fae73a625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:28.358251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f7447-5da2-45ef-8ac9-016fae73a625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:28.359847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4f7447-5da2-45ef-8ac9-016fae73a625 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:28.372029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1096/2168] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:28.657117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d9c18-2998-490d-88c1-7fb050d67c6a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:28.658751 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-be7d9c18-2998-490d-88c1-7fb050d67c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:28.674290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d9c18-2998-490d-88c1-7fb050d67c6a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:28.679100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:28.680127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:28.680469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:28.680814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] PATH_INFO: `/v3/projects/05a162e9ed364fdfb05ebd39d331054c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:28.682145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a162e9ed364fdfb05ebd39d331054c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:28.684088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:28.712477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:28.744255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a162e9ed364fdfb05ebd39d331054c', 'request_id': 'req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.756005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a162e9ed364fdfb05ebd39d331054c', 'request_id': 'req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.768102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a162e9ed364fdfb05ebd39d331054c', 'request_id': 'req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.782431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] The token cache is being invalidate because project 05a162e9ed364fdfb05ebd39d331054c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:28.782730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.783402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:28.785226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1073/2169] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:28 2022] DELETE /identity/v3/projects/05a162e9ed364fdfb05ebd39d331054c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:32.907723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f7447-5da2-45ef-8ac9-016fae73a625 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:32.917143 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f7447-5da2-45ef-8ac9-016fae73a625 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:32.953847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:32.974741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d048060-c3ae-4ef3-beff-36db99a722e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:32.975393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048060-c3ae-4ef3-beff-36db99a722e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:32.975676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048060-c3ae-4ef3-beff-36db99a722e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:32.975955 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d048060-c3ae-4ef3-beff-36db99a722e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:32.977735 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3d048060-c3ae-4ef3-beff-36db99a722e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:33.042940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d048060-c3ae-4ef3-beff-36db99a722e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:33.044418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d048060-c3ae-4ef3-beff-36db99a722e4 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:33.056797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1097/2170] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:38.778724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:43.052181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=34 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:54.483082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:54.484807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:54.563042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceacce0-cbc3-47d6-aac1-3901e5d5f938 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:54.568406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:54.569295 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:54.569580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:54.569860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] PATH_INFO: `/v3/users/3960683257b04ed0b074d63c8b76b590` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:54.571236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3960683257b04ed0b074d63c8b76b590)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:54.573596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:54.639418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3960683257b04ed0b074d63c8b76b590'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:54.640156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3960683257b04ed0b074d63c8b76b590'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:54.650104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3960683257b04ed0b074d63c8b76b590'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:54.660401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3960683257b04ed0b074d63c8b76b590'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:54.674980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3960683257b04ed0b074d63c8b76b590'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:54.681086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1074/2171] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:54 2022] DELETE /identity/v3/users/3960683257b04ed0b074d63c8b76b590 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:54.685768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fc5c6-3a14-4aa1-b6d0-fc2b69be2389 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:54.686286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fc5c6-3a14-4aa1-b6d0-fc2b69be2389 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:54.686380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fc5c6-3a14-4aa1-b6d0-fc2b69be2389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:54.705615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f14fc5c6-3a14-4aa1-b6d0-fc2b69be2389 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:54.706785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f14fc5c6-3a14-4aa1-b6d0-fc2b69be2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:54.766709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1098/2172] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:54.777186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:54.778716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:54.843507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a678522-2eab-4897-beb1-4b4d1a6a59b1 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:54.847715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cbb5e-dcd7-411e-837f-1ff34184d520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:54.848377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cbb5e-dcd7-411e-837f-1ff34184d520 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:54.848659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cbb5e-dcd7-411e-837f-1ff34184d520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:54.848940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cbb5e-dcd7-411e-837f-1ff34184d520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:54.859774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cbb5e-dcd7-411e-837f-1ff34184d520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:54.861308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cbb5e-dcd7-411e-837f-1ff34184d520 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:54.871701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1075/2173] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:42:55.142718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fc5c6-3a14-4aa1-b6d0-fc2b69be2389 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:55.144169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f14fc5c6-3a14-4aa1-b6d0-fc2b69be2389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:55.157013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fc5c6-3a14-4aa1-b6d0-fc2b69be2389 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:55.161861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:55.162805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.163137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.163416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] PATH_INFO: `/v3/projects/541105c56e204565a3805cac6f2d1a16` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.164891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541105c56e204565a3805cac6f2d1a16)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:55.167082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:55.218070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541105c56e204565a3805cac6f2d1a16', 'request_id': 'req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:55.227094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541105c56e204565a3805cac6f2d1a16', 'request_id': 'req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:55.232835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541105c56e204565a3805cac6f2d1a16', 'request_id': 'req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:55.244731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] The token cache is being invalidate because project 541105c56e204565a3805cac6f2d1a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:55.245035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:55.245766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7a59cd4-7af9-41ea-a4e5-7b3c192dd5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:55.247466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1099/2174] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:55 2022] DELETE /identity/v3/projects/541105c56e204565a3805cac6f2d1a16 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:55.254229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaaba8-8958-4c5c-8ca4-68f85f829f6b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.254522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaaba8-8958-4c5c-8ca4-68f85f829f6b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.254802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcaaba8-8958-4c5c-8ca4-68f85f829f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.273483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3fcaaba8-8958-4c5c-8ca4-68f85f829f6b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:55.274717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3fcaaba8-8958-4c5c-8ca4-68f85f829f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:55.292152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:55.342596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1076/2175] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:55.350543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d53d-02e4-45e4-a4d2-553139f588b5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.350829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d53d-02e4-45e4-a4d2-553139f588b5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.351132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d53d-02e4-45e4-a4d2-553139f588b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.376585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-28d7d53d-02e4-45e4-a4d2-553139f588b5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:55.378728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-28d7d53d-02e4-45e4-a4d2-553139f588b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:55.390354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1100/2176] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:55.396165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaaba8-8958-4c5c-8ca4-68f85f829f6b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:55.406795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcaaba8-8958-4c5c-8ca4-68f85f829f6b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:55.414957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:55.415860 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.416162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.416434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.417184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:42:55.417585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:55.419255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:55.432245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1077/2177] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:42:55.436768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d53d-02e4-45e4-a4d2-553139f588b5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:55.447296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d53d-02e4-45e4-a4d2-553139f588b5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:55.453315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e8ad5-68f9-4d16-9149-3b4ed7cd7072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:55.454008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e8ad5-68f9-4d16-9149-3b4ed7cd7072 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.454296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e8ad5-68f9-4d16-9149-3b4ed7cd7072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.454565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e8ad5-68f9-4d16-9149-3b4ed7cd7072 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.455259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e8ad5-68f9-4d16-9149-3b4ed7cd7072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:55.457167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e8ad5-68f9-4d16-9149-3b4ed7cd7072 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:55.485342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1101/2178] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:42:55 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:55.489788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:55.499869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99f6b0-7b29-48d7-86e7-3bd3761b2634 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:55.558169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49a71b-443c-487a-b4d1-0e653ec514e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:55.558830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49a71b-443c-487a-b4d1-0e653ec514e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.559107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49a71b-443c-487a-b4d1-0e653ec514e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.559375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49a71b-443c-487a-b4d1-0e653ec514e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.560062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49a71b-443c-487a-b4d1-0e653ec514e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:55.562048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49a71b-443c-487a-b4d1-0e653ec514e0 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:55.587882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1078/2179] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:42:55 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:42:55.592766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e8ad5-68f9-4d16-9149-3b4ed7cd7072 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:55.604605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e8ad5-68f9-4d16-9149-3b4ed7cd7072 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:55.610182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39fca-174d-46b0-a3e6-c7b11a4a2f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:55.610840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39fca-174d-46b0-a3e6-c7b11a4a2f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.611118 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39fca-174d-46b0-a3e6-c7b11a4a2f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.611391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d39fca-174d-46b0-a3e6-c7b11a4a2f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.612119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39fca-174d-46b0-a3e6-c7b11a4a2f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:55.613705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d39fca-174d-46b0-a3e6-c7b11a4a2f1b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:55.624397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1102/2180] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:55.628691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49a71b-443c-487a-b4d1-0e653ec514e0 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:55.638799 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49a71b-443c-487a-b4d1-0e653ec514e0 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:55.644228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56b78f-3dc7-49d6-9cac-2b432c7583ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:55.644886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b78f-3dc7-49d6-9cac-2b432c7583ed admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.645168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b78f-3dc7-49d6-9cac-2b432c7583ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.645441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56b78f-3dc7-49d6-9cac-2b432c7583ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.646202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56b78f-3dc7-49d6-9cac-2b432c7583ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:55.647802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56b78f-3dc7-49d6-9cac-2b432c7583ed admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:55.657970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1079/2181] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:42:55.661999 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39fca-174d-46b0-a3e6-c7b11a4a2f1b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:55.672190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d39fca-174d-46b0-a3e6-c7b11a4a2f1b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:55.676717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:55.677637 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.677913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.678213 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] PATH_INFO: `/v3/projects/df1be8b5ef574feba49e4b07c0b0eb84/users/ac9a20129aad43e4b882b0f4690062d8/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.694232 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1be8b5ef574feba49e4b07c0b0eb84, user_id=ac9a20129aad43e4b882b0f4690062d8, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:55.696916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:55.713087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1103/2182] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:42:55 2022] PUT /identity/v3/projects/df1be8b5ef574feba49e4b07c0b0eb84/users/ac9a20129aad43e4b882b0f4690062d8/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:42:55.724412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407ad7-4dd6-40eb-bdda-6f306fb01c5c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.724706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407ad7-4dd6-40eb-bdda-6f306fb01c5c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.724986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407ad7-4dd6-40eb-bdda-6f306fb01c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.751754 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-92407ad7-4dd6-40eb-bdda-6f306fb01c5c None None] MFA Rules not processed for user `ac9a20129aad43e4b882b0f4690062d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:55.752909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-92407ad7-4dd6-40eb-bdda-6f306fb01c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:55.821472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1080/2183] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:55.833430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:55.836510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:55.860353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:55.900476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394413-5a65-4d7f-a95e-552838dbbb66 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:55.904855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75fca3-fc20-40a1-8062-fc5fc6d6aa20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:55.905495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75fca3-fc20-40a1-8062-fc5fc6d6aa20 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:55.905776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75fca3-fc20-40a1-8062-fc5fc6d6aa20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:55.906091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75fca3-fc20-40a1-8062-fc5fc6d6aa20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:55.915117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75fca3-fc20-40a1-8062-fc5fc6d6aa20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:55.916555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75fca3-fc20-40a1-8062-fc5fc6d6aa20 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:55.925733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1104/2184] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:58.992173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92407ad7-4dd6-40eb-bdda-6f306fb01c5c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:59.019098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:59.064302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92407ad7-4dd6-40eb-bdda-6f306fb01c5c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:59.069196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:59.070144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:59.070425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:59.070695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] PATH_INFO: `/v3/users/ac9a20129aad43e4b882b0f4690062d8` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:59.071983 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9a20129aad43e4b882b0f4690062d8)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:59.074254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:59.127972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9a20129aad43e4b882b0f4690062d8'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.128710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9a20129aad43e4b882b0f4690062d8'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.137890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9a20129aad43e4b882b0f4690062d8'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.145435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9a20129aad43e4b882b0f4690062d8'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.157498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9a20129aad43e4b882b0f4690062d8'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.163532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1081/2185] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:42:58 2022] DELETE /identity/v3/users/ac9a20129aad43e4b882b0f4690062d8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:59.168436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ebdf6-f599-4bb7-a229-e3bb76927fa1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:59.168931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ebdf6-f599-4bb7-a229-e3bb76927fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:59.169032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ebdf6-f599-4bb7-a229-e3bb76927fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:59.187290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1a7ebdf6-f599-4bb7-a229-e3bb76927fa1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:59.188536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1a7ebdf6-f599-4bb7-a229-e3bb76927fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:59.248013 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1105/2186] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:42:59.258058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:59.259660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:59.330075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344f596-cbec-4878-af90-5ca0130d934f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:59.334679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c0200-52ca-4f5f-90b0-b91c9273d342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:59.335452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c0200-52ca-4f5f-90b0-b91c9273d342 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:59.335770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c0200-52ca-4f5f-90b0-b91c9273d342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:59.336100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c0200-52ca-4f5f-90b0-b91c9273d342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:59.346722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c0200-52ca-4f5f-90b0-b91c9273d342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:59.348166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c0200-52ca-4f5f-90b0-b91c9273d342 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:59.358092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1082/2187] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:42:59.627869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ebdf6-f599-4bb7-a229-e3bb76927fa1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:59.629102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1a7ebdf6-f599-4bb7-a229-e3bb76927fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:59.642970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ebdf6-f599-4bb7-a229-e3bb76927fa1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:59.649594 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:59.650717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:59.650909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:59.651192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] PATH_INFO: `/v3/projects/df1be8b5ef574feba49e4b07c0b0eb84` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:59.652620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1be8b5ef574feba49e4b07c0b0eb84)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:59.654619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:59.708329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1be8b5ef574feba49e4b07c0b0eb84', 'request_id': 'req-627bfb94-e26f-41e5-a59e-16d192b83bbe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.717724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1be8b5ef574feba49e4b07c0b0eb84', 'request_id': 'req-627bfb94-e26f-41e5-a59e-16d192b83bbe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.723765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1be8b5ef574feba49e4b07c0b0eb84', 'request_id': 'req-627bfb94-e26f-41e5-a59e-16d192b83bbe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.734888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] The token cache is being invalidate because project df1be8b5ef574feba49e4b07c0b0eb84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:42:59.735184 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.735898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-627bfb94-e26f-41e5-a59e-16d192b83bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:42:59.737509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1106/2188] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:42:59 2022] DELETE /identity/v3/projects/df1be8b5ef574feba49e4b07c0b0eb84 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:42:59.743602 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98ae9-d98e-4139-a5f0-1c10ff1ca990 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:59.743870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98ae9-d98e-4139-a5f0-1c10ff1ca990 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:59.744231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e98ae9-d98e-4139-a5f0-1c10ff1ca990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:59.762928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-67e98ae9-d98e-4139-a5f0-1c10ff1ca990 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:59.764049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-67e98ae9-d98e-4139-a5f0-1c10ff1ca990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:59.804093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:42:59.836499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1083/2189] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:42:59.844501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235069-f2b6-41f5-8ac8-dfb0973dea40 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:59.844824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235069-f2b6-41f5-8ac8-dfb0973dea40 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:59.845079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235069-f2b6-41f5-8ac8-dfb0973dea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:59.864928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-23235069-f2b6-41f5-8ac8-dfb0973dea40 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:42:59.866224 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-23235069-f2b6-41f5-8ac8-dfb0973dea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:42:59.875600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1107/2190] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:42:59.880224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98ae9-d98e-4139-a5f0-1c10ff1ca990 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:59.890548 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e98ae9-d98e-4139-a5f0-1c10ff1ca990 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:59.896400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:59.897064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:59.897339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:59.898129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:59.898355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:42:59.898670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:59.900291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:59.912787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1084/2191] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:42:59.917678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235069-f2b6-41f5-8ac8-dfb0973dea40 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:59.928577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235069-f2b6-41f5-8ac8-dfb0973dea40 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:42:59.934586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbd6fc-9b37-4700-b9dd-705a448b400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:42:59.935248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd6fc-9b37-4700-b9dd-705a448b400f admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:42:59.935528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd6fc-9b37-4700-b9dd-705a448b400f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:42:59.935801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbd6fc-9b37-4700-b9dd-705a448b400f admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:42:59.936514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbd6fc-9b37-4700-b9dd-705a448b400f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:42:59.938553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbd6fc-9b37-4700-b9dd-705a448b400f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:42:59.966519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1108/2192] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:42:59 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:42:59.972663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:42:59.983708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ee2f5-658d-4e4e-b035-0e39a21caef7 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:00.042824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1387-b004-414d-851f-4e7b66d84936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:00.043451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1387-b004-414d-851f-4e7b66d84936 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:00.043641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1387-b004-414d-851f-4e7b66d84936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:00.043934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1387-b004-414d-851f-4e7b66d84936 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:00.044666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e1387-b004-414d-851f-4e7b66d84936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:00.046643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e1387-b004-414d-851f-4e7b66d84936 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:00.072676 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1085/2193] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:42:59 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:43:00.073895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbd6fc-9b37-4700-b9dd-705a448b400f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:00.084377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbd6fc-9b37-4700-b9dd-705a448b400f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:00.089494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df59ac-e0e6-43b6-aaaf-e93c3057cad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:00.090185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df59ac-e0e6-43b6-aaaf-e93c3057cad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:00.090468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df59ac-e0e6-43b6-aaaf-e93c3057cad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:00.090741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df59ac-e0e6-43b6-aaaf-e93c3057cad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:00.091458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df59ac-e0e6-43b6-aaaf-e93c3057cad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:00.093056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df59ac-e0e6-43b6-aaaf-e93c3057cad3 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:00.103519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1109/2194] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:43:00.108118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1387-b004-414d-851f-4e7b66d84936 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:00.122367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1387-b004-414d-851f-4e7b66d84936 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:00.128204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e250ab4-5e89-4116-99ef-6f90bfff9afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:00.128872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ab4-5e89-4116-99ef-6f90bfff9afd admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:00.129158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ab4-5e89-4116-99ef-6f90bfff9afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:00.129433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e250ab4-5e89-4116-99ef-6f90bfff9afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:00.130284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e250ab4-5e89-4116-99ef-6f90bfff9afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:00.131926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e250ab4-5e89-4116-99ef-6f90bfff9afd admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:00.142551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1086/2195] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:43:00.146578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df59ac-e0e6-43b6-aaaf-e93c3057cad3 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:00.157360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df59ac-e0e6-43b6-aaaf-e93c3057cad3 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:00.163207 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:00.164077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:00.164366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:00.164641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] PATH_INFO: `/v3/projects/4913e0662c5c4a9a86527b882bc5f307/users/3ac46e1d84c343c3a0fb141cdfa4c817/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:00.167155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:00.183220 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4913e0662c5c4a9a86527b882bc5f307, user_id=3ac46e1d84c343c3a0fb141cdfa4c817, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:00.185882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:00.201080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1110/2196] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:43:00 2022] PUT /identity/v3/projects/4913e0662c5c4a9a86527b882bc5f307/users/3ac46e1d84c343c3a0fb141cdfa4c817/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:43:00.211341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd3c2-b206-42fe-a11f-1912be672d8b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:00.211635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd3c2-b206-42fe-a11f-1912be672d8b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:00.211917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd3c2-b206-42fe-a11f-1912be672d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:00.238474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-270dd3c2-b206-42fe-a11f-1912be672d8b None None] MFA Rules not processed for user `3ac46e1d84c343c3a0fb141cdfa4c817`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:00.239701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-270dd3c2-b206-42fe-a11f-1912be672d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:00.307387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1087/2197] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:43:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:00.320313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:00.323726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:00.383904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9647f-0a78-44eb-a533-c6730c8903d4 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:00.387826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b2fae-f74d-4d10-9508-f3846bce3a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:00.388472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2fae-f74d-4d10-9508-f3846bce3a2a service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:00.388752 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2fae-f74d-4d10-9508-f3846bce3a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:00.389030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b2fae-f74d-4d10-9508-f3846bce3a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:00.397542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b2fae-f74d-4d10-9508-f3846bce3a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:00.399019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b2fae-f74d-4d10-9508-f3846bce3a2a service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:00.407890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1111/2198] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:10.303795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:10.403894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:13.782211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd3c2-b206-42fe-a11f-1912be672d8b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:13.849183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd3c2-b206-42fe-a11f-1912be672d8b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:13.854457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:13.855442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:13.855793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:13.856064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] PATH_INFO: `/v3/users/3ac46e1d84c343c3a0fb141cdfa4c817` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:13.857356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac46e1d84c343c3a0fb141cdfa4c817)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:13.859406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:13.908973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac46e1d84c343c3a0fb141cdfa4c817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:13.909622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac46e1d84c343c3a0fb141cdfa4c817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:13.918764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac46e1d84c343c3a0fb141cdfa4c817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:13.926292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac46e1d84c343c3a0fb141cdfa4c817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:13.939399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac46e1d84c343c3a0fb141cdfa4c817'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:13.946080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1088/2199] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:43:13 2022] DELETE /identity/v3/users/3ac46e1d84c343c3a0fb141cdfa4c817 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:43:13.951694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2f06-6fd3-49c8-9963-ef718b936965 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:13.951694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2f06-6fd3-49c8-9963-ef718b936965 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:13.952156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2f06-6fd3-49c8-9963-ef718b936965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:13.970685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2b6d2f06-6fd3-49c8-9963-ef718b936965 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:13.971847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2b6d2f06-6fd3-49c8-9963-ef718b936965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:14.037587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1112/2200] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:43:14.047526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:14.049058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:14.111361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e92d1-5cd6-4350-bfdc-c965c81200a5 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:14.118128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd48257-e23a-4a35-b5f8-941baf55f2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:14.119014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48257-e23a-4a35-b5f8-941baf55f2ef service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:14.119471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48257-e23a-4a35-b5f8-941baf55f2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:14.119850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd48257-e23a-4a35-b5f8-941baf55f2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:14.135115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd48257-e23a-4a35-b5f8-941baf55f2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:14.139230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd48257-e23a-4a35-b5f8-941baf55f2ef service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:14.150445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1089/2201] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:14.441851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d2f06-6fd3-49c8-9963-ef718b936965 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:14.443538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2b6d2f06-6fd3-49c8-9963-ef718b936965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:14.457315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d2f06-6fd3-49c8-9963-ef718b936965 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:14.463075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:14.464028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:14.464373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:14.464726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] PATH_INFO: `/v3/projects/4913e0662c5c4a9a86527b882bc5f307` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:14.466081 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4913e0662c5c4a9a86527b882bc5f307)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:14.468249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:14.517692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4913e0662c5c4a9a86527b882bc5f307', 'request_id': 'req-f50f41c7-c3dd-4483-b879-b0cddd96faa6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:14.526750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4913e0662c5c4a9a86527b882bc5f307', 'request_id': 'req-f50f41c7-c3dd-4483-b879-b0cddd96faa6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:14.532971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4913e0662c5c4a9a86527b882bc5f307', 'request_id': 'req-f50f41c7-c3dd-4483-b879-b0cddd96faa6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:14.544304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] The token cache is being invalidate because project 4913e0662c5c4a9a86527b882bc5f307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:43:14.544687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:14.545380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:43:14.547034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1113/2202] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:43:14 2022] DELETE /identity/v3/projects/4913e0662c5c4a9a86527b882bc5f307 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:43:18.390143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd48257-e23a-4a35-b5f8-941baf55f2ef service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:18.402875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd48257-e23a-4a35-b5f8-941baf55f2ef service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:18.423180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:18.456287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeacd4b-843e-4d8a-8411-c43a822d91f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:18.456931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeacd4b-843e-4d8a-8411-c43a822d91f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:18.457211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeacd4b-843e-4d8a-8411-c43a822d91f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:18.457490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeacd4b-843e-4d8a-8411-c43a822d91f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:18.459362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-edeacd4b-843e-4d8a-8411-c43a822d91f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:18.534630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeacd4b-843e-4d8a-8411-c43a822d91f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:18.536338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeacd4b-843e-4d8a-8411-c43a822d91f2 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:18.548264 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1090/2203] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:21.026225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:21.027724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:21.040160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f41c7-c3dd-4483-b879-b0cddd96faa6 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:21.043878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:21.044548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:21.044835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:21.045118 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:21.046958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:21.062497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:21.064016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:21.076326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1114/2204] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:23.641302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26dda-0c3e-42b7-99a8-bcd440cc42eb None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:23.641742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26dda-0c3e-42b7-99a8-bcd440cc42eb None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:23.641831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f26dda-0c3e-42b7-99a8-bcd440cc42eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:23.661200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-08f26dda-0c3e-42b7-99a8-bcd440cc42eb None None] MFA Rules not processed for user `3229929e0f2f4c9fbb3dc6413b6db151`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:23.662475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-08f26dda-0c3e-42b7-99a8-bcd440cc42eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:23.729142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1091/2205] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:43:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:28.447950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:28.449416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:28.464872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2a8bd-62d3-4a84-a6b9-bb5dfd89ea56 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:28.469871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b727f-5d08-4377-8c4d-c3622813aeeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:28.470553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b727f-5d08-4377-8c4d-c3622813aeeb service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:28.470840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b727f-5d08-4377-8c4d-c3622813aeeb service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:28.471120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b727f-5d08-4377-8c4d-c3622813aeeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:28.472928 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e26b727f-5d08-4377-8c4d-c3622813aeeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:28.484718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b727f-5d08-4377-8c4d-c3622813aeeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:28.486573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b727f-5d08-4377-8c4d-c3622813aeeb service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:28.498765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1115/2206] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:29.655989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26dda-0c3e-42b7-99a8-bcd440cc42eb None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:29.675144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f26dda-0c3e-42b7-99a8-bcd440cc42eb None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:29.682181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:29.682829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:29.683117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:29.683393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:29.685425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:29.745273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:29.746939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:29.756143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1092/2207] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:35.725250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dfe54-f875-4179-a18c-47e76cc8718e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:35.725803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dfe54-f875-4179-a18c-47e76cc8718e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:35.725803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dfe54-f875-4179-a18c-47e76cc8718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:35.745205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8c7dfe54-f875-4179-a18c-47e76cc8718e None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:35.746451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8c7dfe54-f875-4179-a18c-47e76cc8718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:35.802600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1116/2208] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:43:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:35.855670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:35.857092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:35.866548 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:35.931808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20360320-10cc-414e-bf4d-74e4fcbf0450 service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:35.938521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b27106-5b22-4f59-bee1-1990b4ab3f03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:35.939182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b27106-5b22-4f59-bee1-1990b4ab3f03 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:35.939497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b27106-5b22-4f59-bee1-1990b4ab3f03 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:35.939769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b27106-5b22-4f59-bee1-1990b4ab3f03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:35.950537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b27106-5b22-4f59-bee1-1990b4ab3f03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:35.952213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b27106-5b22-4f59-bee1-1990b4ab3f03 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:35.962246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1093/2209] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:43:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:43:41.344641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dfe54-f875-4179-a18c-47e76cc8718e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:41.349496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:41.355764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dfe54-f875-4179-a18c-47e76cc8718e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:41.360971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:41.361834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:41.362323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:41.362707 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:41.365638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:41.452863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:41.455029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:41.472277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1117/2210] 10.222.0.61 () {60 vars in 1396 bytes} [Fri Jul 1 19:43:41 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:45.957690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=29 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:48.406396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b27106-5b22-4f59-bee1-1990b4ab3f03 service swift] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:48.417872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b27106-5b22-4f59-bee1-1990b4ab3f03 service swift] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:48.424425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99446dd1-9e7a-4834-a0a9-94822a6966fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:48.425044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446dd1-9e7a-4834-a0a9-94822a6966fd service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:48.425327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446dd1-9e7a-4834-a0a9-94822a6966fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:48.425603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99446dd1-9e7a-4834-a0a9-94822a6966fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:48.427801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-99446dd1-9e7a-4834-a0a9-94822a6966fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:48.438084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99446dd1-9e7a-4834-a0a9-94822a6966fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:48.439525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99446dd1-9e7a-4834-a0a9-94822a6966fd service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:48.448039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1094/2211] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:51.464186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=27 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:43:51.864747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:51.873979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058e2d2-bf3b-4b20-a971-7f404dac159c service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:51.878782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a783fb1-78e3-42cb-a45b-d28f85de8ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:51.879423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a783fb1-78e3-42cb-a45b-d28f85de8ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:51.879701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a783fb1-78e3-42cb-a45b-d28f85de8ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:51.879991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a783fb1-78e3-42cb-a45b-d28f85de8ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:51.882199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4a783fb1-78e3-42cb-a45b-d28f85de8ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:51.892281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a783fb1-78e3-42cb-a45b-d28f85de8ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:51.893708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a783fb1-78e3-42cb-a45b-d28f85de8ef2 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:51.902052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1118/2212] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:52.020484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c7c1-01c9-4ffd-8d95-f0156acd11cc None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.021051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c7c1-01c9-4ffd-8d95-f0156acd11cc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.021051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8c7c1-01c9-4ffd-8d95-f0156acd11cc None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.022687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1095/2213] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:43:52.029258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187f48-a72a-432d-8a47-27ce0050a971 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.029554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187f48-a72a-432d-8a47-27ce0050a971 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.029839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187f48-a72a-432d-8a47-27ce0050a971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.070345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-60187f48-a72a-432d-8a47-27ce0050a971 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:52.071595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-60187f48-a72a-432d-8a47-27ce0050a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:52.082339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1119/2214] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:43:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:52.093713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c7c1-01c9-4ffd-8d95-f0156acd11cc None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:52.095656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-20d8c7c1-01c9-4ffd-8d95-f0156acd11cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:52.154420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8c7c1-01c9-4ffd-8d95-f0156acd11cc None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:52.157856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b05cbc-6b28-496b-b595-da5489d9d022 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1a1889e2fb436a86c5e68bf9f1e608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:52.158538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05cbc-6b28-496b-b595-da5489d9d022 service glance] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.158820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05cbc-6b28-496b-b595-da5489d9d022 service glance] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.159091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05cbc-6b28-496b-b595-da5489d9d022 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.169054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b05cbc-6b28-496b-b595-da5489d9d022 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:52.170520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b05cbc-6b28-496b-b595-da5489d9d022 service glance] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:52.181194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1096/2215] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:52.255431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847e34-9408-455d-8218-f4d804729bf7 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.255759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847e34-9408-455d-8218-f4d804729bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.256114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f847e34-9408-455d-8218-f4d804729bf7 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.258307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1120/2216] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:43:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:43:52.263220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a24ea-8c3f-4958-939e-c77dd7a8e5fc None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.263504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a24ea-8c3f-4958-939e-c77dd7a8e5fc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.263798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a24ea-8c3f-4958-939e-c77dd7a8e5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.283173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f91a24ea-8c3f-4958-939e-c77dd7a8e5fc None None] MFA Rules not processed for user `9fcc425392664c17b72fb4655f8fb7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:52.284372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f91a24ea-8c3f-4958-939e-c77dd7a8e5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:52.291522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1097/2217] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:43:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:52.306456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f847e34-9408-455d-8218-f4d804729bf7 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:52.308578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5f847e34-9408-455d-8218-f4d804729bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:52.324467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f847e34-9408-455d-8218-f4d804729bf7 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:52.328141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fa57e-3e4d-47e6-af40-1889a1c6fdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:52.328790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa57e-3e4d-47e6-af40-1889a1c6fdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.329076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa57e-3e4d-47e6-af40-1889a1c6fdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.329398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa57e-3e4d-47e6-af40-1889a1c6fdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.336750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fa57e-3e4d-47e6-af40-1889a1c6fdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:52.338212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fa57e-3e4d-47e6-af40-1889a1c6fdd7 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:52.346440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1121/2218] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:52.436797 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff1ef-22e7-4446-b0ad-81392c349ead None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.437117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff1ef-22e7-4446-b0ad-81392c349ead None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.437370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff1ef-22e7-4446-b0ad-81392c349ead None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.438923 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1098/2219] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:43:52.444457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c4d4c-6dda-4b29-b85b-4823b3024a9d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.444748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c4d4c-6dda-4b29-b85b-4823b3024a9d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.445021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c4d4c-6dda-4b29-b85b-4823b3024a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.465100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-110c4d4c-6dda-4b29-b85b-4823b3024a9d None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:52.466336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-110c4d4c-6dda-4b29-b85b-4823b3024a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:52.476880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1122/2220] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:43:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:52.490079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ff1ef-22e7-4446-b0ad-81392c349ead None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:52.503613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ff1ef-22e7-4446-b0ad-81392c349ead None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:52.507450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d28521-0487-4263-bc1f-e869787506a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:52.508090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d28521-0487-4263-bc1f-e869787506a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.508369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d28521-0487-4263-bc1f-e869787506a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.508649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d28521-0487-4263-bc1f-e869787506a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.519285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d28521-0487-4263-bc1f-e869787506a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:52.520731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d28521-0487-4263-bc1f-e869787506a7 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:52.531514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1099/2221] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:52.596635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c4d4c-6dda-4b29-b85b-4823b3024a9d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:52.598183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-110c4d4c-6dda-4b29-b85b-4823b3024a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:52.668950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c4d4c-6dda-4b29-b85b-4823b3024a9d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:52.674803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:52.675571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:52.675844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:52.676139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:52.678277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:52.690899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:52.692524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:52.703410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1123/2222] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:43:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:43:55.827202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3de9b-8c8b-48cd-ad42-86b57b2824bc None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:55.827708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3de9b-8c8b-48cd-ad42-86b57b2824bc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:55.827708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3de9b-8c8b-48cd-ad42-86b57b2824bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:55.846941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-1de3de9b-8c8b-48cd-ad42-86b57b2824bc None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:43:55.848243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1de3de9b-8c8b-48cd-ad42-86b57b2824bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:43:55.855736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1100/2223] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:43:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:43:55.867642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:43:55.879398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467fed8-82c6-4e79-99dd-64754dd59224 service placement] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:43:55.884833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adebcaf-b16d-4ffe-be1e-cc1c92d652a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:43:55.885495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adebcaf-b16d-4ffe-be1e-cc1c92d652a3 service swift] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:43:55.885773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adebcaf-b16d-4ffe-be1e-cc1c92d652a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:43:55.886095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adebcaf-b16d-4ffe-be1e-cc1c92d652a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:43:55.894328 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adebcaf-b16d-4ffe-be1e-cc1c92d652a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:43:55.895916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adebcaf-b16d-4ffe-be1e-cc1c92d652a3 service swift] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:43:55.904111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1124/2224] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:43:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:44:05.841804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=44 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:05.900816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=62 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:16.222089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3de9b-8c8b-48cd-ad42-86b57b2824bc None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:44:16.223749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1de3de9b-8c8b-48cd-ad42-86b57b2824bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:16.240933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3de9b-8c8b-48cd-ad42-86b57b2824bc None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:44:16.248213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:44:16.248869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:44:16.249152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:44:16.249434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:44:16.251623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:16.324586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:44:16.326149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:44:16.336490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1101/2225] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:44:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:44:26.331103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=28 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:27.387298 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d1b5d-97ce-49ca-9563-591313d227c8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:44:27.387838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d1b5d-97ce-49ca-9563-591313d227c8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:44:27.387938 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d1b5d-97ce-49ca-9563-591313d227c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:44:27.409108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-a21d1b5d-97ce-49ca-9563-591313d227c8 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:44:27.410364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a21d1b5d-97ce-49ca-9563-591313d227c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:27.418071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1125/2226] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jul 1 19:44:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:44:27.430291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:44:27.441867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0a4a0-eec7-4f3a-af8c-077bada80122 service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:44:27.447361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867cd90-8c02-47ee-9a76-080ac49f5601 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:44:27.448007 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867cd90-8c02-47ee-9a76-080ac49f5601 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:44:27.448287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867cd90-8c02-47ee-9a76-080ac49f5601 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:44:27.448559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867cd90-8c02-47ee-9a76-080ac49f5601 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:44:27.456925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867cd90-8c02-47ee-9a76-080ac49f5601 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:44:27.458553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867cd90-8c02-47ee-9a76-080ac49f5601 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:44:27.466605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1102/2227] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:44:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 19:44:37.403727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:37.463433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:44:49.262228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabdf01-39cc-4308-89df-51d9b8225539 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:44:49.262753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabdf01-39cc-4308-89df-51d9b8225539 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:44:49.262855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabdf01-39cc-4308-89df-51d9b8225539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:44:49.281926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-0fabdf01-39cc-4308-89df-51d9b8225539 None None] MFA Rules not processed for user `bf5ff69a857f412fb65dce1b59a22e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:44:49.283137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0fabdf01-39cc-4308-89df-51d9b8225539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:49.291099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1126/2228] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:44:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:44:55.744140 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867cd90-8c02-47ee-9a76-080ac49f5601 service swift] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:44:55.756453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867cd90-8c02-47ee-9a76-080ac49f5601 service swift] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:44:55.762124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a20c-8cfa-482c-a78b-4fa540975da0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:44:55.762775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a20c-8cfa-482c-a78b-4fa540975da0 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:44:55.763058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a20c-8cfa-482c-a78b-4fa540975da0 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:44:55.763369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a20c-8cfa-482c-a78b-4fa540975da0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:44:55.765216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b3b2a20c-8cfa-482c-a78b-4fa540975da0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:44:55.778142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2a20c-8cfa-482c-a78b-4fa540975da0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:44:55.779757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2a20c-8cfa-482c-a78b-4fa540975da0 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:44:55.791740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1103/2229] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:44:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:44:59.275743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:05.786368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:29.314575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabdf01-39cc-4308-89df-51d9b8225539 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:29.329382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabdf01-39cc-4308-89df-51d9b8225539 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:29.335392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7668b7-9644-4a1e-b159-72204abb995e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:29.336107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7668b7-9644-4a1e-b159-72204abb995e service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:29.336392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7668b7-9644-4a1e-b159-72204abb995e service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:29.336663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7668b7-9644-4a1e-b159-72204abb995e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:29.338474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9a7668b7-9644-4a1e-b159-72204abb995e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:29.351473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7668b7-9644-4a1e-b159-72204abb995e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:29.353212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7668b7-9644-4a1e-b159-72204abb995e service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:29.365218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1127/2230] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:31.856826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2280c6e-2b84-4f20-9112-dc8c1471ad95 None None] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:31.857481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2280c6e-2b84-4f20-9112-dc8c1471ad95 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:31.857481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2280c6e-2b84-4f20-9112-dc8c1471ad95 None None] PATH_INFO: `/` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:31.858853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1104/2231] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:45:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:45:31.865288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58638-7c4f-48f5-8287-c992235cdcfc None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:31.866457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58638-7c4f-48f5-8287-c992235cdcfc None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:31.867021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e58638-7c4f-48f5-8287-c992235cdcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:31.894742 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f4e58638-7c4f-48f5-8287-c992235cdcfc None None] MFA Rules not processed for user `9fcc425392664c17b72fb4655f8fb7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:31.895994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f4e58638-7c4f-48f5-8287-c992235cdcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:31.903988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1128/2232] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:45:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:31.916604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2280c6e-2b84-4f20-9112-dc8c1471ad95 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:31.930117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2280c6e-2b84-4f20-9112-dc8c1471ad95 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:31.935252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0155b6-d796-4603-96f5-b54a4d42a070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:31.936038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0155b6-d796-4603-96f5-b54a4d42a070 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:31.936354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0155b6-d796-4603-96f5-b54a4d42a070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:31.936626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0155b6-d796-4603-96f5-b54a4d42a070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:31.945879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0155b6-d796-4603-96f5-b54a4d42a070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:31.947823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0155b6-d796-4603-96f5-b54a4d42a070 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:31.957392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1105/2233] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:32.051115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70111-f63b-4f38-b175-20e031829864 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:32.051404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70111-f63b-4f38-b175-20e031829864 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:32.051692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae70111-f63b-4f38-b175-20e031829864 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:32.053183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1129/2234] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:45:32.059612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9110-dab0-4f59-bea4-c2b014141b75 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:32.059898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9110-dab0-4f59-bea4-c2b014141b75 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:32.060375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c9110-dab0-4f59-bea4-c2b014141b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:32.080536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-de9c9110-dab0-4f59-bea4-c2b014141b75 None None] MFA Rules not processed for user `d78ccd9541dc48cfbdfc116dcec91a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:32.081765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-de9c9110-dab0-4f59-bea4-c2b014141b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:32.091239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1106/2235] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:45:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:32.102077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70111-f63b-4f38-b175-20e031829864 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:32.114290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae70111-f63b-4f38-b175-20e031829864 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:32.118434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ebfa9-1c71-4bca-92cc-306a89d19bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:32.119167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ebfa9-1c71-4bca-92cc-306a89d19bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:32.119534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ebfa9-1c71-4bca-92cc-306a89d19bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:32.119869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ebfa9-1c71-4bca-92cc-306a89d19bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:32.131744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ebfa9-1c71-4bca-92cc-306a89d19bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:32.133208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ebfa9-1c71-4bca-92cc-306a89d19bd0 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:32.144896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1130/2236] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:33.317449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c9110-dab0-4f59-bea4-c2b014141b75 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:33.342472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c9110-dab0-4f59-bea4-c2b014141b75 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:33.351356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:33.352239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:33.352623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:33.353642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:33.356425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:33.373663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:33.375316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:33.387748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1107/2237] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:42.140007 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=15 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:43.279169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a2852-071e-4098-af4b-8b505dd002d0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:43.279770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a2852-071e-4098-af4b-8b505dd002d0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:43.279770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a2852-071e-4098-af4b-8b505dd002d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:43.298479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-421a2852-071e-4098-af4b-8b505dd002d0 None None] MFA Rules not processed for user `3229929e0f2f4c9fbb3dc6413b6db151`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:43.299701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-421a2852-071e-4098-af4b-8b505dd002d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:43.307885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1131/2238] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:45:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:45:43.382079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=15 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:43.635015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:45:43.647514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7391e-9e6b-4dd2-b04c-254e628790da service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:45:43.652482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:45:43.653413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:43.653833 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:43.654244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:43.656679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:43.668571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:45:43.670045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:45:43.678375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1108/2239] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:45:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:45:53.293132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:53.674582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:57.716993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd332a-0928-439e-9480-74c1614e7fc0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:45:57.717397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd332a-0928-439e-9480-74c1614e7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:45:57.717553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd332a-0928-439e-9480-74c1614e7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:45:57.735257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-55cd332a-0928-439e-9480-74c1614e7fc0 None None] MFA Rules not processed for user `b5040520134e464ea1d534767ea8728e`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:45:57.736471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-55cd332a-0928-439e-9480-74c1614e7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:45:57.743541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1132/2240] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:45:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:46:07.730183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:27.677060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:27.686695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e20ba-268e-4afd-80bd-69b40bd3e40a service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:27.691488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e6956-7156-4bee-9061-eddf45b30d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:27.692240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e6956-7156-4bee-9061-eddf45b30d20 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:27.692559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e6956-7156-4bee-9061-eddf45b30d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:27.692932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e6956-7156-4bee-9061-eddf45b30d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:27.695195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-479e6956-7156-4bee-9061-eddf45b30d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:27.769156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e6956-7156-4bee-9061-eddf45b30d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:27.770766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e6956-7156-4bee-9061-eddf45b30d20 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:27.782312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1109/2241] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:31.135480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0182-5cbb-414c-9d19-a313e531dc90 None None] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.137217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0182-5cbb-414c-9d19-a313e531dc90 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.137656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db0182-5cbb-414c-9d19-a313e531dc90 None None] PATH_INFO: `/` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.140190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1133/2242] 10.222.0.61 () {54 vars in 921 bytes} [Fri Jul 1 19:46:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 19:46:31.151805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b5e8-80be-4b47-890c-a39d87d3cfd6 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.152375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b5e8-80be-4b47-890c-a39d87d3cfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.152375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78b5e8-80be-4b47-890c-a39d87d3cfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.182360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-cc78b5e8-80be-4b47-890c-a39d87d3cfd6 None None] MFA Rules not processed for user `6f6684cfbbc54d568730d44c923770ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:31.183617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cc78b5e8-80be-4b47-890c-a39d87d3cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:31.193583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1110/2243] 10.222.0.61 () {58 vars in 1018 bytes} [Fri Jul 1 19:46:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:31.209493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db0182-5cbb-414c-9d19-a313e531dc90 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:31.222715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78b5e8-80be-4b47-890c-a39d87d3cfd6 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:31.224192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cc78b5e8-80be-4b47-890c-a39d87d3cfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:31.231031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db0182-5cbb-414c-9d19-a313e531dc90 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:31.238532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cdc2e-9ffb-4de4-b42e-fb1162c62c96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:31.239424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cdc2e-9ffb-4de4-b42e-fb1162c62c96 service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.239715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cdc2e-9ffb-4de4-b42e-fb1162c62c96 service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.239997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cdc2e-9ffb-4de4-b42e-fb1162c62c96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.240116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78b5e8-80be-4b47-890c-a39d87d3cfd6 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:31.245326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:31.246301 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.246587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.246861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] PATH_INFO: `/v3/users/bf5ff69a857f412fb65dce1b59a22e9d` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.248111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5ff69a857f412fb65dce1b59a22e9d)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:31.249695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cdc2e-9ffb-4de4-b42e-fb1162c62c96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:31.250158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:31.251447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cdc2e-9ffb-4de4-b42e-fb1162c62c96 service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:31.262010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1134/2244] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:31.307101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5ff69a857f412fb65dce1b59a22e9d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.307999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5ff69a857f412fb65dce1b59a22e9d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.318487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5ff69a857f412fb65dce1b59a22e9d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.326173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5ff69a857f412fb65dce1b59a22e9d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.338378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b744208a-0fac-4feb-af6f-831c947e7627 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5ff69a857f412fb65dce1b59a22e9d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.344509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1111/2245] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:31 2022] DELETE /identity/v3/users/bf5ff69a857f412fb65dce1b59a22e9d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:31.535371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cdc2e-9ffb-4de4-b42e-fb1162c62c96 service placement] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:31.549200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cdc2e-9ffb-4de4-b42e-fb1162c62c96 service placement] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:31.608949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:31.609816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.610142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.610419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] PATH_INFO: `/v3/projects/bd397adb95a6455b8e78db9b132d865e` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.611676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd397adb95a6455b8e78db9b132d865e)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:31.613611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:31.661566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd397adb95a6455b8e78db9b132d865e', 'request_id': 'req-2f83582a-3cc5-4f39-8712-15e62a5b134c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.670182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd397adb95a6455b8e78db9b132d865e', 'request_id': 'req-2f83582a-3cc5-4f39-8712-15e62a5b134c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.676137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd397adb95a6455b8e78db9b132d865e', 'request_id': 'req-2f83582a-3cc5-4f39-8712-15e62a5b134c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.687380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] The token cache is being invalidate because project bd397adb95a6455b8e78db9b132d865e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:31.687650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.688329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2f83582a-3cc5-4f39-8712-15e62a5b134c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:31.689916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1135/2246] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:31 2022] DELETE /identity/v3/projects/bd397adb95a6455b8e78db9b132d865e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:31.695146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b83e5-54ac-4ffb-8557-06e8465884e3 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.695455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b83e5-54ac-4ffb-8557-06e8465884e3 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.695712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b83e5-54ac-4ffb-8557-06e8465884e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.714095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7f4b83e5-54ac-4ffb-8557-06e8465884e3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:31.715307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7f4b83e5-54ac-4ffb-8557-06e8465884e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:31.769845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:31.781230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1112/2247] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:31.789984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325c02b-3e17-4897-85da-ae4398452fb6 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.790274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325c02b-3e17-4897-85da-ae4398452fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.790552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325c02b-3e17-4897-85da-ae4398452fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.809124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-3325c02b-3e17-4897-85da-ae4398452fb6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:31.810428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3325c02b-3e17-4897-85da-ae4398452fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:31.818653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1136/2248] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:31.823322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b83e5-54ac-4ffb-8557-06e8465884e3 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:31.833376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b83e5-54ac-4ffb-8557-06e8465884e3 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:31.838292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:31.838945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.839221 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.839494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.840225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:46:31.840533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:31.842174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:31.853976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1113/2249] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:46:31.858482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325c02b-3e17-4897-85da-ae4398452fb6 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:31.868247 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325c02b-3e17-4897-85da-ae4398452fb6 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:31.873723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4421c-6e5a-49a3-94cd-e18b2a839990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:31.874404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4421c-6e5a-49a3-94cd-e18b2a839990 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.874687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4421c-6e5a-49a3-94cd-e18b2a839990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.874963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4421c-6e5a-49a3-94cd-e18b2a839990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.875660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4421c-6e5a-49a3-94cd-e18b2a839990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:31.877572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee4421c-6e5a-49a3-94cd-e18b2a839990 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:31.922263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1137/2250] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:31 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:31.927340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:31.938690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6542dbd-f328-4479-afd0-49f7a0ea946e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:31.995981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae53406-96bc-40cd-b76f-c70793c06ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:31.996657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53406-96bc-40cd-b76f-c70793c06ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:31.996946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53406-96bc-40cd-b76f-c70793c06ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:31.997227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae53406-96bc-40cd-b76f-c70793c06ccc admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:31.997929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae53406-96bc-40cd-b76f-c70793c06ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:31.999887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae53406-96bc-40cd-b76f-c70793c06ccc admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:32.024400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1114/2251] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:31 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:32.028802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4421c-6e5a-49a3-94cd-e18b2a839990 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:32.041762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4421c-6e5a-49a3-94cd-e18b2a839990 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:32.046691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da129e0a-ca41-475f-ab96-96e6a18e0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:32.047361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da129e0a-ca41-475f-ab96-96e6a18e0cab admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:32.047644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da129e0a-ca41-475f-ab96-96e6a18e0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:32.047922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da129e0a-ca41-475f-ab96-96e6a18e0cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:32.048726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da129e0a-ca41-475f-ab96-96e6a18e0cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:32.050504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da129e0a-ca41-475f-ab96-96e6a18e0cab admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:32.061019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1138/2252] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:46:32.065111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae53406-96bc-40cd-b76f-c70793c06ccc admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:32.076452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae53406-96bc-40cd-b76f-c70793c06ccc admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:32.082328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baec85-891c-4ad4-8467-391c207246ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:32.083027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baec85-891c-4ad4-8467-391c207246ef admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:32.083315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baec85-891c-4ad4-8467-391c207246ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:32.083579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baec85-891c-4ad4-8467-391c207246ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:32.084313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baec85-891c-4ad4-8467-391c207246ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:32.085932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baec85-891c-4ad4-8467-391c207246ef admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:32.096294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1115/2253] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:32.100696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da129e0a-ca41-475f-ab96-96e6a18e0cab admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:32.111659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da129e0a-ca41-475f-ab96-96e6a18e0cab admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:32.117577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:32.118493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:32.118770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:32.119041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] PATH_INFO: `/v3/projects/98c960f00ca549bb9a649b9d1374a69b/users/9dcd619f7c4341479f27831ce0887f0f/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:32.135114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c960f00ca549bb9a649b9d1374a69b, user_id=9dcd619f7c4341479f27831ce0887f0f, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:32.137757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:32.153593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1139/2254] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:32 2022] PUT /identity/v3/projects/98c960f00ca549bb9a649b9d1374a69b/users/9dcd619f7c4341479f27831ce0887f0f/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:32.168239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388e4b-a099-4b5f-879a-ae76b5693dcf None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:32.168699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388e4b-a099-4b5f-879a-ae76b5693dcf None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:32.168792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9388e4b-a099-4b5f-879a-ae76b5693dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:32.197670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b9388e4b-a099-4b5f-879a-ae76b5693dcf None None] MFA Rules not processed for user `9dcd619f7c4341479f27831ce0887f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:32.198912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b9388e4b-a099-4b5f-879a-ae76b5693dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:32.270182 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1116/2255] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:32.282808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:32.285851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:32.294386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:32.366197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce1bcc-9aaa-40ba-ad2e-5384ba751473 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:32.373030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8447e0f-6524-496c-83aa-620c8d868c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:32.373709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8447e0f-6524-496c-83aa-620c8d868c7b service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:32.374001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8447e0f-6524-496c-83aa-620c8d868c7b service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:32.374300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8447e0f-6524-496c-83aa-620c8d868c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:32.382439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8447e0f-6524-496c-83aa-620c8d868c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:32.384112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8447e0f-6524-496c-83aa-620c8d868c7b service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:32.392968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1140/2256] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:32.623621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9388e4b-a099-4b5f-879a-ae76b5693dcf None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:32.682026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:32.688232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9388e4b-a099-4b5f-879a-ae76b5693dcf None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:32.693499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:32.694419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:32.694699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:32.694976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] PATH_INFO: `/v3/users/9dcd619f7c4341479f27831ce0887f0f` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:32.696515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dcd619f7c4341479f27831ce0887f0f)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:32.698485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:32.748900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dcd619f7c4341479f27831ce0887f0f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:32.749562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dcd619f7c4341479f27831ce0887f0f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:32.757791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dcd619f7c4341479f27831ce0887f0f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:32.764905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dcd619f7c4341479f27831ce0887f0f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:32.777000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dcd619f7c4341479f27831ce0887f0f'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:32.782837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1117/2257] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:32 2022] DELETE /identity/v3/users/9dcd619f7c4341479f27831ce0887f0f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:32.788787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ffba-924d-451d-892e-a9971e05b4cd None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:32.789226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ffba-924d-451d-892e-a9971e05b4cd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:32.789756 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72ffba-924d-451d-892e-a9971e05b4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:32.808687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-aa72ffba-924d-451d-892e-a9971e05b4cd None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:32.810211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-aa72ffba-924d-451d-892e-a9971e05b4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:32.875953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1141/2258] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:32.886266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:32.887841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:32.950251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c7f9c-729c-45f1-a9f4-729b69a6e089 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:32.956659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c09034-a189-4659-b892-b5a40e48bbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:32.957585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09034-a189-4659-b892-b5a40e48bbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:32.958005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09034-a189-4659-b892-b5a40e48bbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:32.958380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c09034-a189-4659-b892-b5a40e48bbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:32.974172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c09034-a189-4659-b892-b5a40e48bbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:32.975947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c09034-a189-4659-b892-b5a40e48bbf1 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:32.986491 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1118/2259] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:33.269101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72ffba-924d-451d-892e-a9971e05b4cd None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:33.270640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-aa72ffba-924d-451d-892e-a9971e05b4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:33.282927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72ffba-924d-451d-892e-a9971e05b4cd None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:33.287857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:33.288727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.289014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.289294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] PATH_INFO: `/v3/projects/98c960f00ca549bb9a649b9d1374a69b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.290581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c960f00ca549bb9a649b9d1374a69b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:33.292586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:33.356715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c960f00ca549bb9a649b9d1374a69b', 'request_id': 'req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:33.365993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c960f00ca549bb9a649b9d1374a69b', 'request_id': 'req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:33.372993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c960f00ca549bb9a649b9d1374a69b', 'request_id': 'req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:33.384910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] The token cache is being invalidate because project 98c960f00ca549bb9a649b9d1374a69b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:33.385208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:33.385976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-81a1e616-5e6e-4c20-b8d1-cccf688b7ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:33.387651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1142/2260] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:33 2022] DELETE /identity/v3/projects/98c960f00ca549bb9a649b9d1374a69b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:33.392861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5674e-0107-424c-9d71-86b8e4cdd4b0 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.393375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5674e-0107-424c-9d71-86b8e4cdd4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.393375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5674e-0107-424c-9d71-86b8e4cdd4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.412293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-dcf5674e-0107-424c-9d71-86b8e4cdd4b0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:33.413501 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-dcf5674e-0107-424c-9d71-86b8e4cdd4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:33.477083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1119/2261] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:33.489126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c736c-f59d-4cd8-8db7-9c3608920feb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.489412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c736c-f59d-4cd8-8db7-9c3608920feb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.489773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c736c-f59d-4cd8-8db7-9c3608920feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.510560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d38c736c-f59d-4cd8-8db7-9c3608920feb None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:33.511804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d38c736c-f59d-4cd8-8db7-9c3608920feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:33.523437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1143/2262] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:33.528190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5674e-0107-424c-9d71-86b8e4cdd4b0 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:33.541832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5674e-0107-424c-9d71-86b8e4cdd4b0 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:33.546730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:33.547375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.547660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.547938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.548694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:46:33.548989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:33.550642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:33.562314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1120/2263] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:46:33.566903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c736c-f59d-4cd8-8db7-9c3608920feb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:33.576817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c736c-f59d-4cd8-8db7-9c3608920feb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:33.584935 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e37dc1-e671-4a26-b1fb-913b41de08d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:33.585631 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37dc1-e671-4a26-b1fb-913b41de08d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.585908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37dc1-e671-4a26-b1fb-913b41de08d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.586229 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e37dc1-e671-4a26-b1fb-913b41de08d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.586959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e37dc1-e671-4a26-b1fb-913b41de08d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:33.588908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e37dc1-e671-4a26-b1fb-913b41de08d9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:33.592481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:33.618832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1144/2264] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:33 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:33.624160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:33.630783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:33.635366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be2a91-0801-4cb9-948e-6506b3e5d977 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:33.695634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27480d35-565e-40f3-81dd-5b6dfd7a229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:33.696687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27480d35-565e-40f3-81dd-5b6dfd7a229d admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.696962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27480d35-565e-40f3-81dd-5b6dfd7a229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.697231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27480d35-565e-40f3-81dd-5b6dfd7a229d admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.697928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27480d35-565e-40f3-81dd-5b6dfd7a229d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:33.699868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27480d35-565e-40f3-81dd-5b6dfd7a229d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:33.728058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1121/2265] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:33 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:46:33.732246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e37dc1-e671-4a26-b1fb-913b41de08d9 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:33.743135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e37dc1-e671-4a26-b1fb-913b41de08d9 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:33.747833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941f265-7109-4770-bf26-203943b1b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:33.748491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f265-7109-4770-bf26-203943b1b14f admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.748773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f265-7109-4770-bf26-203943b1b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.749049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941f265-7109-4770-bf26-203943b1b14f admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.749781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941f265-7109-4770-bf26-203943b1b14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:33.751421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941f265-7109-4770-bf26-203943b1b14f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:33.761436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1145/2266] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:33.765201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27480d35-565e-40f3-81dd-5b6dfd7a229d admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:33.775706 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27480d35-565e-40f3-81dd-5b6dfd7a229d admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:33.780965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4b548-9ad0-464e-893c-ebd35e40d207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:33.781618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4b548-9ad0-464e-893c-ebd35e40d207 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.781900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4b548-9ad0-464e-893c-ebd35e40d207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.782188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4b548-9ad0-464e-893c-ebd35e40d207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.782915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4b548-9ad0-464e-893c-ebd35e40d207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:33.784679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4b548-9ad0-464e-893c-ebd35e40d207 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:33.796427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1122/2267] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:33.800528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941f265-7109-4770-bf26-203943b1b14f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:33.813569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941f265-7109-4770-bf26-203943b1b14f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:33.820252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c8a7b-72de-447f-9a04-612742c814fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:33.821797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c8a7b-72de-447f-9a04-612742c814fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.822121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c8a7b-72de-447f-9a04-612742c814fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.822398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c8a7b-72de-447f-9a04-612742c814fe admin admin] PATH_INFO: `/v3/projects/131bbb34cbbb4c52a3be14919b29531e/users/2f62ee0d574449e280fc21157cda8a43/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.837877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c8a7b-72de-447f-9a04-612742c814fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=131bbb34cbbb4c52a3be14919b29531e, user_id=2f62ee0d574449e280fc21157cda8a43, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:33.840578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657c8a7b-72de-447f-9a04-612742c814fe admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:33.855848 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1146/2268] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:33 2022] PUT /identity/v3/projects/131bbb34cbbb4c52a3be14919b29531e/users/2f62ee0d574449e280fc21157cda8a43/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:46:33.867546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510902-c5b5-40cc-9e9b-114ae9b08efd None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:33.867838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510902-c5b5-40cc-9e9b-114ae9b08efd None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:33.868117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd510902-c5b5-40cc-9e9b-114ae9b08efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:33.896342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bd510902-c5b5-40cc-9e9b-114ae9b08efd None None] MFA Rules not processed for user `2f62ee0d574449e280fc21157cda8a43`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:33.897470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bd510902-c5b5-40cc-9e9b-114ae9b08efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:33.965804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1123/2269] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:33.970613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c8a7b-72de-447f-9a04-612742c814fe admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:34.033985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657c8a7b-72de-447f-9a04-612742c814fe admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:34.039725 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45153-1b09-4595-9e85-8d4cb8529511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:34.040387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45153-1b09-4595-9e85-8d4cb8529511 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.040666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45153-1b09-4595-9e85-8d4cb8529511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.041231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd45153-1b09-4595-9e85-8d4cb8529511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.041939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45153-1b09-4595-9e85-8d4cb8529511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:34.043933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd45153-1b09-4595-9e85-8d4cb8529511 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:34.073706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1147/2270] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:33 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:34.079259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510902-c5b5-40cc-9e9b-114ae9b08efd None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:34.090236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd510902-c5b5-40cc-9e9b-114ae9b08efd None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:34.148522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf7e6-f49d-4fc4-a610-d11b7fa1ddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:34.149158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf7e6-f49d-4fc4-a610-d11b7fa1ddeb admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.149436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf7e6-f49d-4fc4-a610-d11b7fa1ddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.149712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf7e6-f49d-4fc4-a610-d11b7fa1ddeb admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.150453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf7e6-f49d-4fc4-a610-d11b7fa1ddeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:34.152414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdf7e6-f49d-4fc4-a610-d11b7fa1ddeb admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:34.174737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1124/2271] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:34 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:46:34.178954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45153-1b09-4595-9e85-8d4cb8529511 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:34.189989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd45153-1b09-4595-9e85-8d4cb8529511 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:34.194749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294e919-a502-4a4c-8a6d-95d01c68fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:34.195418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294e919-a502-4a4c-8a6d-95d01c68fdd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.195702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294e919-a502-4a4c-8a6d-95d01c68fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.196340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294e919-a502-4a4c-8a6d-95d01c68fdd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.197116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294e919-a502-4a4c-8a6d-95d01c68fdd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:34.198745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294e919-a502-4a4c-8a6d-95d01c68fdd9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:34.209517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1148/2272] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:34.214423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf7e6-f49d-4fc4-a610-d11b7fa1ddeb admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:34.222583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:34.230731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdf7e6-f49d-4fc4-a610-d11b7fa1ddeb admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:34.236184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27244e-c800-4581-b42d-d920fadf45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:34.237092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27244e-c800-4581-b42d-d920fadf45c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.237376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27244e-c800-4581-b42d-d920fadf45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.237655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27244e-c800-4581-b42d-d920fadf45c1 admin admin] PATH_INFO: `/v3/projects/77c6841d8f114147837a99e862dbfe68/users/22a38a86093e478d8be5589840025f10/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.253399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27244e-c800-4581-b42d-d920fadf45c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c6841d8f114147837a99e862dbfe68, user_id=22a38a86093e478d8be5589840025f10, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:34.256110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27244e-c800-4581-b42d-d920fadf45c1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:34.272324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1125/2273] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:34 2022] PUT /identity/v3/projects/77c6841d8f114147837a99e862dbfe68/users/22a38a86093e478d8be5589840025f10/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:34.276526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294e919-a502-4a4c-8a6d-95d01c68fdd9 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:34.286989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294e919-a502-4a4c-8a6d-95d01c68fdd9 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:34.347317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3eb222-13ba-4e73-895e-c4313abfd34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:34.347987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eb222-13ba-4e73-895e-c4313abfd34e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.348267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eb222-13ba-4e73-895e-c4313abfd34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.348540 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eb222-13ba-4e73-895e-c4313abfd34e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.349273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3eb222-13ba-4e73-895e-c4313abfd34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:34.350949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3eb222-13ba-4e73-895e-c4313abfd34e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:34.361062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1149/2274] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:34.365377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27244e-c800-4581-b42d-d920fadf45c1 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:34.376293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27244e-c800-4581-b42d-d920fadf45c1 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:34.382036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:34.382928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.383211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.383528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] PATH_INFO: `/v3/projects/77c6841d8f114147837a99e862dbfe68/users/22a38a86093e478d8be5589840025f10/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.385750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c6841d8f114147837a99e862dbfe68, user_id=22a38a86093e478d8be5589840025f10, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:34.388469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:34.400954 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1126/2275] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:34 2022] PUT /identity/v3/projects/77c6841d8f114147837a99e862dbfe68/users/22a38a86093e478d8be5589840025f10/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:34.411720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2840f-d26b-4979-a37f-078624178583 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.412069 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2840f-d26b-4979-a37f-078624178583 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.412437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2840f-d26b-4979-a37f-078624178583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.439582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-90b2840f-d26b-4979-a37f-078624178583 None None] MFA Rules not processed for user `22a38a86093e478d8be5589840025f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:34.440787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-90b2840f-d26b-4979-a37f-078624178583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:34.449973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:34.521702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1150/2276] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:34.533633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:34.535654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:34.598883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8370bc-c0c0-46f2-a814-d71b6c5c7891 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:34.603040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:34.603684 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.604026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.604209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.613358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:34.614820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:34.625566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1127/2277] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:34 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:34.718293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2840f-d26b-4979-a37f-078624178583 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:34.728111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2840f-d26b-4979-a37f-078624178583 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:34.732031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41400df-b98c-449c-9bb9-f4ba50958ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:34.732669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41400df-b98c-449c-9bb9-f4ba50958ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:34.732948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41400df-b98c-449c-9bb9-f4ba50958ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:34.733226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41400df-b98c-449c-9bb9-f4ba50958ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:34.791035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41400df-b98c-449c-9bb9-f4ba50958ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:34.792468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41400df-b98c-449c-9bb9-f4ba50958ec6 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:34.801328 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1151/2278] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:44.620524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=40,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:44.797269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=53 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:45.769749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:45.771188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:45.841995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0cdb65-7013-49cd-8049-7e601b1b8fcc service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:45.847666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813cbcf-2385-4917-abed-20a964d7841f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:45.848323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813cbcf-2385-4917-abed-20a964d7841f service placement] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:45.848603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813cbcf-2385-4917-abed-20a964d7841f service placement] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:45.848897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813cbcf-2385-4917-abed-20a964d7841f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:45.850848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f813cbcf-2385-4917-abed-20a964d7841f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:45.862907 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813cbcf-2385-4917-abed-20a964d7841f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:45.864513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813cbcf-2385-4917-abed-20a964d7841f service placement] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:45.874750 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1128/2279] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:46.177925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41400df-b98c-449c-9bb9-f4ba50958ec6 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:46.241761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41400df-b98c-449c-9bb9-f4ba50958ec6 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:46.247098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:46.247988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:46.248339 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:46.248621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] PATH_INFO: `/v3/users/2f62ee0d574449e280fc21157cda8a43` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:46.249921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f62ee0d574449e280fc21157cda8a43)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:46.252044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:46.310608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f62ee0d574449e280fc21157cda8a43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:46.321606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f62ee0d574449e280fc21157cda8a43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:46.322546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f62ee0d574449e280fc21157cda8a43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:46.335628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f62ee0d574449e280fc21157cda8a43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:46.350833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f62ee0d574449e280fc21157cda8a43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:46.358647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1152/2280] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:46 2022] DELETE /identity/v3/users/2f62ee0d574449e280fc21157cda8a43 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:46.363163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed54b-3c7e-495b-a9a7-ee8ce4d7053f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:46.363453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed54b-3c7e-495b-a9a7-ee8ce4d7053f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:46.363790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aed54b-3c7e-495b-a9a7-ee8ce4d7053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:46.381653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-37aed54b-3c7e-495b-a9a7-ee8ce4d7053f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:46.382925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-37aed54b-3c7e-495b-a9a7-ee8ce4d7053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:46.449994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1129/2281] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:46:46.460183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:46.461888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:46.532103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c8fb4-2e25-426f-85e2-e120edb14468 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:46.536263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a50f0-2cef-4a04-943e-e96c960896d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:46.536929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a50f0-2cef-4a04-943e-e96c960896d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:46.537246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a50f0-2cef-4a04-943e-e96c960896d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:46.537519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a50f0-2cef-4a04-943e-e96c960896d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:46.547633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a50f0-2cef-4a04-943e-e96c960896d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:46.549141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a50f0-2cef-4a04-943e-e96c960896d1 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:46.560279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1153/2282] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:47.113777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aed54b-3c7e-495b-a9a7-ee8ce4d7053f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:47.115326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-37aed54b-3c7e-495b-a9a7-ee8ce4d7053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:47.127465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aed54b-3c7e-495b-a9a7-ee8ce4d7053f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:47.135176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:47.136062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:47.136341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:47.136612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] PATH_INFO: `/v3/projects/131bbb34cbbb4c52a3be14919b29531e` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:47.137898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=131bbb34cbbb4c52a3be14919b29531e)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:47.139920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:47.197820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131bbb34cbbb4c52a3be14919b29531e', 'request_id': 'req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.208549 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131bbb34cbbb4c52a3be14919b29531e', 'request_id': 'req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.215302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131bbb34cbbb4c52a3be14919b29531e', 'request_id': 'req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.226682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] The token cache is being invalidate because project 131bbb34cbbb4c52a3be14919b29531e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:47.226976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.227616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.229244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1130/2283] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:47 2022] DELETE /identity/v3/projects/131bbb34cbbb4c52a3be14919b29531e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:46:47.233272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a50f0-2cef-4a04-943e-e96c960896d1 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:47.243595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a50f0-2cef-4a04-943e-e96c960896d1 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:47.262112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:47.310697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:47.311588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:47.311869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:47.312152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] PATH_INFO: `/v3/users/22a38a86093e478d8be5589840025f10` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:47.313436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a38a86093e478d8be5589840025f10)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:47.315515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:47.368370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a38a86093e478d8be5589840025f10'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.377441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a38a86093e478d8be5589840025f10'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.378165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a38a86093e478d8be5589840025f10'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.388445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a38a86093e478d8be5589840025f10'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.401281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1cc1a273-a815-4f97-97b9-71ea241f9067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a38a86093e478d8be5589840025f10'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.408117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1154/2284] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:47 2022] DELETE /identity/v3/users/22a38a86093e478d8be5589840025f10 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:47.763127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:47.767441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:47.797349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676b5b-47e3-4a1e-ab2c-f8d112b75cdb admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:47.811820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:47.864497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:47.865452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:47.865788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:47.866194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] PATH_INFO: `/v3/projects/77c6841d8f114147837a99e862dbfe68` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:47.867385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c6841d8f114147837a99e862dbfe68)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:47.869360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:47.920214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c6841d8f114147837a99e862dbfe68', 'request_id': 'req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.928214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c6841d8f114147837a99e862dbfe68', 'request_id': 'req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.934191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c6841d8f114147837a99e862dbfe68', 'request_id': 'req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.945281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] The token cache is being invalidate because project 77c6841d8f114147837a99e862dbfe68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:47.945571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.946616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4114efd0-c859-4b8f-a530-6f9b1d21cfb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:47.948275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1131/2285] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:47 2022] DELETE /identity/v3/projects/77c6841d8f114147837a99e862dbfe68 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:47.954682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6af9c-fdc2-458c-a05a-51b4f2444c8a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:47.954938 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6af9c-fdc2-458c-a05a-51b4f2444c8a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:47.955370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6af9c-fdc2-458c-a05a-51b4f2444c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:47.973542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-7df6af9c-fdc2-458c-a05a-51b4f2444c8a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:47.974768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7df6af9c-fdc2-458c-a05a-51b4f2444c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:48.034555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1155/2286] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:48.043640 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5801-8c4b-4830-8ad2-d14e4ef36d3c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.043937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5801-8c4b-4830-8ad2-d14e4ef36d3c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.044218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5801-8c4b-4830-8ad2-d14e4ef36d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.068375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-8bcc5801-8c4b-4830-8ad2-d14e4ef36d3c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:48.069758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8bcc5801-8c4b-4830-8ad2-d14e4ef36d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:48.082082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1132/2287] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:48.083293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6af9c-fdc2-458c-a05a-51b4f2444c8a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.094239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df6af9c-fdc2-458c-a05a-51b4f2444c8a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.099320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.100178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.100466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.100758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.101494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:46:48.101798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.103486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.115664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1156/2288] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:46:48.120356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc5801-8c4b-4830-8ad2-d14e4ef36d3c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.129787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc5801-8c4b-4830-8ad2-d14e4ef36d3c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.134762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429016bb-b2ac-40d2-b609-d3fbbc33f73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.135502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429016bb-b2ac-40d2-b609-d3fbbc33f73b admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.135856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429016bb-b2ac-40d2-b609-d3fbbc33f73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.136139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429016bb-b2ac-40d2-b609-d3fbbc33f73b admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.136900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429016bb-b2ac-40d2-b609-d3fbbc33f73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.138850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429016bb-b2ac-40d2-b609-d3fbbc33f73b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.167935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1133/2289] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:48 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:46:48.169208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.179389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f6b36-edf6-43e9-b9c8-2ff621f6dbac admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.207265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:48.241058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c87589-978c-48d6-8e06-bbf161934339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.241769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87589-978c-48d6-8e06-bbf161934339 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.242023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87589-978c-48d6-8e06-bbf161934339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.242300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c87589-978c-48d6-8e06-bbf161934339 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.243030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c87589-978c-48d6-8e06-bbf161934339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.245082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c87589-978c-48d6-8e06-bbf161934339 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.269195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1157/2290] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:48 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:48.270487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429016bb-b2ac-40d2-b609-d3fbbc33f73b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.281300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429016bb-b2ac-40d2-b609-d3fbbc33f73b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.287014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f972f24-44ed-4d80-950c-6886eae92340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.287687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f972f24-44ed-4d80-950c-6886eae92340 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.287976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f972f24-44ed-4d80-950c-6886eae92340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.288251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f972f24-44ed-4d80-950c-6886eae92340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.289009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f972f24-44ed-4d80-950c-6886eae92340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.290657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f972f24-44ed-4d80-950c-6886eae92340 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.302481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1134/2291] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:48.307512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c87589-978c-48d6-8e06-bbf161934339 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.318026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c87589-978c-48d6-8e06-bbf161934339 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.323638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb62b1-0f7a-4017-ae2e-5f7c9dd5852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.324319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb62b1-0f7a-4017-ae2e-5f7c9dd5852e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.324721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb62b1-0f7a-4017-ae2e-5f7c9dd5852e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.324995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb62b1-0f7a-4017-ae2e-5f7c9dd5852e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.325869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb62b1-0f7a-4017-ae2e-5f7c9dd5852e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.327565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb62b1-0f7a-4017-ae2e-5f7c9dd5852e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.341138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1158/2292] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:48.342432 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f972f24-44ed-4d80-950c-6886eae92340 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.352627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f972f24-44ed-4d80-950c-6886eae92340 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.357781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37821437-7452-4656-8398-ec5609f000ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.358690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37821437-7452-4656-8398-ec5609f000ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.358963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37821437-7452-4656-8398-ec5609f000ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.359253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37821437-7452-4656-8398-ec5609f000ea admin admin] PATH_INFO: `/v3/projects/bf2130e940bb4a1486d80fca375a84e7/users/0e4f7b6277bb4537b4d20354df6e8aa7/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.374993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37821437-7452-4656-8398-ec5609f000ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2130e940bb4a1486d80fca375a84e7, user_id=0e4f7b6277bb4537b4d20354df6e8aa7, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.377678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37821437-7452-4656-8398-ec5609f000ea admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.392022 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1135/2293] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:48 2022] PUT /identity/v3/projects/bf2130e940bb4a1486d80fca375a84e7/users/0e4f7b6277bb4537b4d20354df6e8aa7/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:48.402708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb4c3a-6ed2-4763-a174-7381c09219fe None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.403352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb4c3a-6ed2-4763-a174-7381c09219fe None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.403641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb4c3a-6ed2-4763-a174-7381c09219fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.431903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-eafb4c3a-6ed2-4763-a174-7381c09219fe None None] MFA Rules not processed for user `0e4f7b6277bb4537b4d20354df6e8aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:48.433127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-eafb4c3a-6ed2-4763-a174-7381c09219fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:48.498361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1159/2294] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:48.503252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37821437-7452-4656-8398-ec5609f000ea admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.546585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:48.568572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37821437-7452-4656-8398-ec5609f000ea admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.574304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dd5af-a9b0-487f-a126-c28ef9bfae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.575006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dd5af-a9b0-487f-a126-c28ef9bfae77 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.575253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dd5af-a9b0-487f-a126-c28ef9bfae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.575535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dd5af-a9b0-487f-a126-c28ef9bfae77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.576277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68dd5af-a9b0-487f-a126-c28ef9bfae77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.578473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68dd5af-a9b0-487f-a126-c28ef9bfae77 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.606490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1136/2295] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:48 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:48.610244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb4c3a-6ed2-4763-a174-7381c09219fe None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.620971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb4c3a-6ed2-4763-a174-7381c09219fe None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.682837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6728-af1f-460c-acb3-e936f7736a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.683525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6728-af1f-460c-acb3-e936f7736a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.683803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6728-af1f-460c-acb3-e936f7736a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.684071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a6728-af1f-460c-acb3-e936f7736a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.684764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6728-af1f-460c-acb3-e936f7736a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.686836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a6728-af1f-460c-acb3-e936f7736a4e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.687455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908361-ad7c-448d-9c98-8aef9630e9fa None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.687858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908361-ad7c-448d-9c98-8aef9630e9fa None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.688205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908361-ad7c-448d-9c98-8aef9630e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.711720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1160/2296] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:48 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:46:48.711968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-02908361-ad7c-448d-9c98-8aef9630e9fa None None] MFA Rules not processed for user `c4167eeb95ca4a95a7db1c8e2491a411`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:48.715371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-02908361-ad7c-448d-9c98-8aef9630e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:48.715495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6728-af1f-460c-acb3-e936f7736a4e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.724469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a6728-af1f-460c-acb3-e936f7736a4e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.730041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb66f7-d0ff-4d81-b8d8-097a5fe55aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.730717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb66f7-d0ff-4d81-b8d8-097a5fe55aef admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.731002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb66f7-d0ff-4d81-b8d8-097a5fe55aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.731276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb66f7-d0ff-4d81-b8d8-097a5fe55aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.732016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb66f7-d0ff-4d81-b8d8-097a5fe55aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.733630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb66f7-d0ff-4d81-b8d8-097a5fe55aef admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.744280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1161/2297] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:46:48.748456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb66f7-d0ff-4d81-b8d8-097a5fe55aef admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.758463 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb66f7-d0ff-4d81-b8d8-097a5fe55aef admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.763310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7291f5-4465-4678-bcc3-09ae535ee426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.764279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7291f5-4465-4678-bcc3-09ae535ee426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.764571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7291f5-4465-4678-bcc3-09ae535ee426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.764852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7291f5-4465-4678-bcc3-09ae535ee426 admin admin] PATH_INFO: `/v3/projects/c8d88d732dc743389d0cec557a5acfbb/users/ccbed0f8b61f4335bb2ae5f2821c0d18/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.776959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:48.779011 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1137/2298] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:46:48.780074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7291f5-4465-4678-bcc3-09ae535ee426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d88d732dc743389d0cec557a5acfbb, user_id=ccbed0f8b61f4335bb2ae5f2821c0d18, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.783253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7291f5-4465-4678-bcc3-09ae535ee426 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.797858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1162/2299] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:48 2022] PUT /identity/v3/projects/c8d88d732dc743389d0cec557a5acfbb/users/ccbed0f8b61f4335bb2ae5f2821c0d18/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:46:48.801861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908361-ad7c-448d-9c98-8aef9630e9fa None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.812554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908361-ad7c-448d-9c98-8aef9630e9fa None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.872872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce721a4-3b49-4137-b16f-6a013f7d2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.873583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce721a4-3b49-4137-b16f-6a013f7d2ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.873864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce721a4-3b49-4137-b16f-6a013f7d2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.874188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce721a4-3b49-4137-b16f-6a013f7d2ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.874895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce721a4-3b49-4137-b16f-6a013f7d2ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.876518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce721a4-3b49-4137-b16f-6a013f7d2ff7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.886921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1138/2300] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:46:48.891242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7291f5-4465-4678-bcc3-09ae535ee426 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:48.901781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7291f5-4465-4678-bcc3-09ae535ee426 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:48.906468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:48.907410 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.907761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.908041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] PATH_INFO: `/v3/projects/c8d88d732dc743389d0cec557a5acfbb/users/ccbed0f8b61f4335bb2ae5f2821c0d18/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.910038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d88d732dc743389d0cec557a5acfbb, user_id=ccbed0f8b61f4335bb2ae5f2821c0d18, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:48.912692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:48.923651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1163/2301] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:48 2022] PUT /identity/v3/projects/c8d88d732dc743389d0cec557a5acfbb/users/ccbed0f8b61f4335bb2ae5f2821c0d18/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:46:48.934155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8947c-d082-4ae6-aee3-5e4e6ae50d7e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:48.934606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8947c-d082-4ae6-aee3-5e4e6ae50d7e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:48.934891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8947c-d082-4ae6-aee3-5e4e6ae50d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:48.964647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-42b8947c-d082-4ae6-aee3-5e4e6ae50d7e None None] MFA Rules not processed for user `ccbed0f8b61f4335bb2ae5f2821c0d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:48.965869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-42b8947c-d082-4ae6-aee3-5e4e6ae50d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:49.021428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:49.042935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1139/2302] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:49.056142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:49.058991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:49.121741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7751d22-7173-4a2e-aae0-56291eeae694 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:49.125469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195386-5e55-4989-8820-ecc7a1696df1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:49.126159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195386-5e55-4989-8820-ecc7a1696df1 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:49.126439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195386-5e55-4989-8820-ecc7a1696df1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:49.126712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c195386-5e55-4989-8820-ecc7a1696df1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:49.136610 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c195386-5e55-4989-8820-ecc7a1696df1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:49.138072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c195386-5e55-4989-8820-ecc7a1696df1 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:49.148287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1164/2303] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:49.231450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8947c-d082-4ae6-aee3-5e4e6ae50d7e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:49.241616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8947c-d082-4ae6-aee3-5e4e6ae50d7e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:49.245584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d6823-9257-4af8-9f54-c2d73b6565cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:49.246294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d6823-9257-4af8-9f54-c2d73b6565cb service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:49.246571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d6823-9257-4af8-9f54-c2d73b6565cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:49.246846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d6823-9257-4af8-9f54-c2d73b6565cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:49.306584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d6823-9257-4af8-9f54-c2d73b6565cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:49.308033 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d6823-9257-4af8-9f54-c2d73b6565cb service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:49.316937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1140/2304] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:54.200502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195386-5e55-4989-8820-ecc7a1696df1 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:54.262604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c195386-5e55-4989-8820-ecc7a1696df1 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:54.267461 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:54.268344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:54.268624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:54.268911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] PATH_INFO: `/v3/users/0e4f7b6277bb4537b4d20354df6e8aa7` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:54.270140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e4f7b6277bb4537b4d20354df6e8aa7)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:54.272276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:54.328965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e4f7b6277bb4537b4d20354df6e8aa7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.337748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e4f7b6277bb4537b4d20354df6e8aa7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.338389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e4f7b6277bb4537b4d20354df6e8aa7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.345125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e4f7b6277bb4537b4d20354df6e8aa7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.356634 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e4f7b6277bb4537b4d20354df6e8aa7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.358719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:54.363451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1165/2305] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:54 2022] DELETE /identity/v3/users/0e4f7b6277bb4537b4d20354df6e8aa7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:54.367869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8399a-8fb4-4e83-b907-590428c78809 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:54.368349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8399a-8fb4-4e83-b907-590428c78809 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:54.368534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a8399a-8fb4-4e83-b907-590428c78809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:54.386309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b9a8399a-8fb4-4e83-b907-590428c78809 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:54.387518 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b9a8399a-8fb4-4e83-b907-590428c78809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:54.451346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1141/2306] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:54.463805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:54.465472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:54.527737 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e7d42-dfbe-442e-8b6a-873c926f943a admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:54.534980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989235d-dab5-433f-81ef-48f6213d441d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:54.535917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989235d-dab5-433f-81ef-48f6213d441d service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:54.536304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989235d-dab5-433f-81ef-48f6213d441d service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:54.536683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989235d-dab5-433f-81ef-48f6213d441d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:54.549322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989235d-dab5-433f-81ef-48f6213d441d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:54.550740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989235d-dab5-433f-81ef-48f6213d441d service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:54.560824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1166/2307] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:54.853834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8399a-8fb4-4e83-b907-590428c78809 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:54.855405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b9a8399a-8fb4-4e83-b907-590428c78809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:54.870757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a8399a-8fb4-4e83-b907-590428c78809 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:54.875682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:54.877310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:54.877605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:54.877914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] PATH_INFO: `/v3/projects/bf2130e940bb4a1486d80fca375a84e7` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:54.879167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2130e940bb4a1486d80fca375a84e7)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:54.881173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:54.933321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2130e940bb4a1486d80fca375a84e7', 'request_id': 'req-8632185c-2de2-47dd-9918-cb6d0bae7c1e'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.943001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2130e940bb4a1486d80fca375a84e7', 'request_id': 'req-8632185c-2de2-47dd-9918-cb6d0bae7c1e'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.949371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2130e940bb4a1486d80fca375a84e7', 'request_id': 'req-8632185c-2de2-47dd-9918-cb6d0bae7c1e'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.961018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] The token cache is being invalidate because project bf2130e940bb4a1486d80fca375a84e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:54.961301 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.961940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:54.963537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1142/2308] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:54 2022] DELETE /identity/v3/projects/bf2130e940bb4a1486d80fca375a84e7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:54.967653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989235d-dab5-433f-81ef-48f6213d441d service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:54.977290 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989235d-dab5-433f-81ef-48f6213d441d service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:55.033208 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:55.034093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:55.034509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:55.034785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] PATH_INFO: `/v3/users/ccbed0f8b61f4335bb2ae5f2821c0d18` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:55.036006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccbed0f8b61f4335bb2ae5f2821c0d18)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:55.037914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:55.090965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccbed0f8b61f4335bb2ae5f2821c0d18'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.099416 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccbed0f8b61f4335bb2ae5f2821c0d18'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.099941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccbed0f8b61f4335bb2ae5f2821c0d18'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.106691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccbed0f8b61f4335bb2ae5f2821c0d18'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.119365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3ac30508-20d3-48f5-9e66-7be0f7489933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccbed0f8b61f4335bb2ae5f2821c0d18'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.125851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1167/2309] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:54 2022] DELETE /identity/v3/users/ccbed0f8b61f4335bb2ae5f2821c0d18 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:55.467282 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:55.469012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:55.482969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632185c-2de2-47dd-9918-cb6d0bae7c1e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:55.493871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:55.560161 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:55.561180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:55.561466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:55.561769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] PATH_INFO: `/v3/projects/c8d88d732dc743389d0cec557a5acfbb` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:55.562999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d88d732dc743389d0cec557a5acfbb)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:55.565039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:55.613097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d88d732dc743389d0cec557a5acfbb', 'request_id': 'req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.623185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d88d732dc743389d0cec557a5acfbb', 'request_id': 'req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.629288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d88d732dc743389d0cec557a5acfbb', 'request_id': 'req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.640643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] The token cache is being invalidate because project c8d88d732dc743389d0cec557a5acfbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:55.640928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.641566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b3a2fdc-85f6-4960-96c5-5821e6a8e3f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:55.644097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1143/2310] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:55 2022] DELETE /identity/v3/projects/c8d88d732dc743389d0cec557a5acfbb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:55.648373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6928a-95e7-4a1d-bdd7-a717b96a7b2a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:55.648839 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6928a-95e7-4a1d-bdd7-a717b96a7b2a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:55.649043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6928a-95e7-4a1d-bdd7-a717b96a7b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:55.667348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-67e6928a-95e7-4a1d-bdd7-a717b96a7b2a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:55.668658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-67e6928a-95e7-4a1d-bdd7-a717b96a7b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:55.687049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:55.734472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1168/2311] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:55.743570 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96052-239d-48c9-808c-179a2f28982d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:55.744058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96052-239d-48c9-808c-179a2f28982d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:55.744373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d96052-239d-48c9-808c-179a2f28982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:55.763498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-38d96052-239d-48c9-808c-179a2f28982d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:55.764718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-38d96052-239d-48c9-808c-179a2f28982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:55.773313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1144/2312] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:46:55.777794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6928a-95e7-4a1d-bdd7-a717b96a7b2a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:55.788796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6928a-95e7-4a1d-bdd7-a717b96a7b2a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:55.794378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:55.795130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:55.795449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:55.795723 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:55.796467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:46:55.796773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:55.798452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:55.816085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1169/2313] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:46:55.817553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96052-239d-48c9-808c-179a2f28982d None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:55.827901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d96052-239d-48c9-808c-179a2f28982d None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:55.833254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d58f-4dbf-493d-a2e0-bb4893064061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:55.833735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d58f-4dbf-493d-a2e0-bb4893064061 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:55.834057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d58f-4dbf-493d-a2e0-bb4893064061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:55.834338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618d58f-4dbf-493d-a2e0-bb4893064061 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:55.835175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618d58f-4dbf-493d-a2e0-bb4893064061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:55.837357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618d58f-4dbf-493d-a2e0-bb4893064061 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:55.877271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1145/2314] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:55 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:55.878651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:55.889324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1ce0d-ac51-4720-9670-1d45f00ff459 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:55.960200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4823c68-1f5b-4624-8246-5db404309f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:55.961100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4823c68-1f5b-4624-8246-5db404309f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:55.961453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4823c68-1f5b-4624-8246-5db404309f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:55.961901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4823c68-1f5b-4624-8246-5db404309f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:55.962719 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4823c68-1f5b-4624-8246-5db404309f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:55.965250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4823c68-1f5b-4624-8246-5db404309f48 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:55.990075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1170/2315] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:55 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:55.991369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d58f-4dbf-493d-a2e0-bb4893064061 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.003426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618d58f-4dbf-493d-a2e0-bb4893064061 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.008634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74da705-676d-499a-a6ea-016ff8c56cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.009389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74da705-676d-499a-a6ea-016ff8c56cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.009743 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74da705-676d-499a-a6ea-016ff8c56cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.010121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74da705-676d-499a-a6ea-016ff8c56cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.011054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74da705-676d-499a-a6ea-016ff8c56cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.012672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74da705-676d-499a-a6ea-016ff8c56cf6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.023896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1146/2316] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:56.028139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4823c68-1f5b-4624-8246-5db404309f48 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.039260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4823c68-1f5b-4624-8246-5db404309f48 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.043904 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9f932-6c75-459e-94f5-8b829a952a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.044605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f932-6c75-459e-94f5-8b829a952a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.044891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f932-6c75-459e-94f5-8b829a952a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.045169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9f932-6c75-459e-94f5-8b829a952a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.045907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9f932-6c75-459e-94f5-8b829a952a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.047557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a9f932-6c75-459e-94f5-8b829a952a43 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.061865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1171/2317] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:46:56.066156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74da705-676d-499a-a6ea-016ff8c56cf6 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.077211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74da705-676d-499a-a6ea-016ff8c56cf6 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.081832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d91044-9a0e-461f-bbfa-83c312d7954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.082772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d91044-9a0e-461f-bbfa-83c312d7954d admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.083059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d91044-9a0e-461f-bbfa-83c312d7954d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.083339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d91044-9a0e-461f-bbfa-83c312d7954d admin admin] PATH_INFO: `/v3/projects/304c8b10156348c39d7a8a7793a409df/users/d013d2a302434d1d86b248e5c43dcc60/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.103881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d91044-9a0e-461f-bbfa-83c312d7954d admin admin] RBAC: Authorizing `identity:create_grant(project_id=304c8b10156348c39d7a8a7793a409df, user_id=d013d2a302434d1d86b248e5c43dcc60, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.107226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d91044-9a0e-461f-bbfa-83c312d7954d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.122369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1147/2318] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:56 2022] PUT /identity/v3/projects/304c8b10156348c39d7a8a7793a409df/users/d013d2a302434d1d86b248e5c43dcc60/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:56.136029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8f8c-822f-427d-a583-00f14e241c39 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.136320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8f8c-822f-427d-a583-00f14e241c39 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.136608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d8f8c-822f-427d-a583-00f14e241c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.163057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-680d8f8c-822f-427d-a583-00f14e241c39 None None] MFA Rules not processed for user `d013d2a302434d1d86b248e5c43dcc60`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:56.164267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-680d8f8c-822f-427d-a583-00f14e241c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:56.232119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1172/2319] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:56.236580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d91044-9a0e-461f-bbfa-83c312d7954d admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.280168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:56.301211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d91044-9a0e-461f-bbfa-83c312d7954d admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.306225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d0d64-50a0-4d94-8c56-3f44083bebcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.306891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d0d64-50a0-4d94-8c56-3f44083bebcf admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.307207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d0d64-50a0-4d94-8c56-3f44083bebcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.307481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d0d64-50a0-4d94-8c56-3f44083bebcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.308179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d0d64-50a0-4d94-8c56-3f44083bebcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.310145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d0d64-50a0-4d94-8c56-3f44083bebcf admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.345648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1148/2320] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:56 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:56.349843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d8f8c-822f-427d-a583-00f14e241c39 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.361305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d8f8c-822f-427d-a583-00f14e241c39 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.374492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:56.421151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75294fcc-1839-4968-96b4-2d58da65a50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.421823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294fcc-1839-4968-96b4-2d58da65a50b admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.422157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294fcc-1839-4968-96b4-2d58da65a50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.422442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75294fcc-1839-4968-96b4-2d58da65a50b admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.423156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75294fcc-1839-4968-96b4-2d58da65a50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.425091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75294fcc-1839-4968-96b4-2d58da65a50b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.448024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1173/2321] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:56 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:56.452162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d0d64-50a0-4d94-8c56-3f44083bebcf admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.462607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d0d64-50a0-4d94-8c56-3f44083bebcf admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.467377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e63fc-77af-4986-9641-693a0ff863b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.468034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e63fc-77af-4986-9641-693a0ff863b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.468317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e63fc-77af-4986-9641-693a0ff863b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.468591 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e63fc-77af-4986-9641-693a0ff863b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.469332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e63fc-77af-4986-9641-693a0ff863b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.470967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e63fc-77af-4986-9641-693a0ff863b1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.481530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1149/2322] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:56.485681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75294fcc-1839-4968-96b4-2d58da65a50b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.496825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75294fcc-1839-4968-96b4-2d58da65a50b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.502188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07ba1a-42b5-47e7-a924-77bcdc5cf629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.503097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07ba1a-42b5-47e7-a924-77bcdc5cf629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.503380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07ba1a-42b5-47e7-a924-77bcdc5cf629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.503656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07ba1a-42b5-47e7-a924-77bcdc5cf629 admin admin] PATH_INFO: `/v3/projects/8bb2127f81504705bfc18e28b41d4002/users/35d6e0bdc64a4f109d1cea57d9eff0f0/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.520510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07ba1a-42b5-47e7-a924-77bcdc5cf629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb2127f81504705bfc18e28b41d4002, user_id=35d6e0bdc64a4f109d1cea57d9eff0f0, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.523188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07ba1a-42b5-47e7-a924-77bcdc5cf629 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.538621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1174/2323] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:56 2022] PUT /identity/v3/projects/8bb2127f81504705bfc18e28b41d4002/users/35d6e0bdc64a4f109d1cea57d9eff0f0/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:56.542696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e63fc-77af-4986-9641-693a0ff863b1 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.553455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e63fc-77af-4986-9641-693a0ff863b1 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.613678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd1bbf-48f7-4b0c-b2d9-9e11021360d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.614556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd1bbf-48f7-4b0c-b2d9-9e11021360d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.614837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd1bbf-48f7-4b0c-b2d9-9e11021360d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.615131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd1bbf-48f7-4b0c-b2d9-9e11021360d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.615898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd1bbf-48f7-4b0c-b2d9-9e11021360d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.617510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd1bbf-48f7-4b0c-b2d9-9e11021360d3 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.630863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1150/2324] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:56.634736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07ba1a-42b5-47e7-a924-77bcdc5cf629 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.646214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07ba1a-42b5-47e7-a924-77bcdc5cf629 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.651289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.652258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.652602 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.652941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] PATH_INFO: `/v3/projects/8bb2127f81504705bfc18e28b41d4002/users/35d6e0bdc64a4f109d1cea57d9eff0f0/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.655175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb2127f81504705bfc18e28b41d4002, user_id=35d6e0bdc64a4f109d1cea57d9eff0f0, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.657903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.670474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1175/2325] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:56 2022] PUT /identity/v3/projects/8bb2127f81504705bfc18e28b41d4002/users/35d6e0bdc64a4f109d1cea57d9eff0f0/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:56.682179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a55f-9a5c-4474-b7cf-3b867b927609 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.682461 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a55f-9a5c-4474-b7cf-3b867b927609 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.682726 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a55f-9a5c-4474-b7cf-3b867b927609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.710008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-2dd9a55f-9a5c-4474-b7cf-3b867b927609 None None] MFA Rules not processed for user `35d6e0bdc64a4f109d1cea57d9eff0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:56.711225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2dd9a55f-9a5c-4474-b7cf-3b867b927609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:56.779735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1151/2326] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:56.791878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:56.793653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:56.856696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0b0d-87e9-4df6-9bd5-cebaa966be1b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:56.861387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7cbd9-e690-4290-a70d-00c87ad70337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:56.862070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cbd9-e690-4290-a70d-00c87ad70337 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:56.862351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cbd9-e690-4290-a70d-00c87ad70337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:56.862620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7cbd9-e690-4290-a70d-00c87ad70337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:56.872559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7cbd9-e690-4290-a70d-00c87ad70337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:56.873990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7cbd9-e690-4290-a70d-00c87ad70337 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:56.883681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1176/2327] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:57.504959 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a55f-9a5c-4474-b7cf-3b867b927609 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:57.544647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:57.576335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a55f-9a5c-4474-b7cf-3b867b927609 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:57.582350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:57.583230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:57.583532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:57.583808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] PATH_INFO: `/v3/users/d013d2a302434d1d86b248e5c43dcc60` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:57.585061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d013d2a302434d1d86b248e5c43dcc60)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:57.587056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:57.641656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd013d2a302434d1d86b248e5c43dcc60'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:57.642332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd013d2a302434d1d86b248e5c43dcc60'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:57.652809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd013d2a302434d1d86b248e5c43dcc60'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:57.664376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd013d2a302434d1d86b248e5c43dcc60'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:57.678421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd013d2a302434d1d86b248e5c43dcc60'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:57.684465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1152/2328] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:57 2022] DELETE /identity/v3/users/d013d2a302434d1d86b248e5c43dcc60 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:57.689297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16c9f-b2a3-479c-b828-32cdbe420edf None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:57.689795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16c9f-b2a3-479c-b828-32cdbe420edf None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:57.689924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e16c9f-b2a3-479c-b828-32cdbe420edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:57.708908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d4e16c9f-b2a3-479c-b828-32cdbe420edf None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:57.710158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d4e16c9f-b2a3-479c-b828-32cdbe420edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:57.770698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1177/2329] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:57.781347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:57.783241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:57.844777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc4b4f-7281-48bd-a4bb-99638dd6684a admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:57.849088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ac13b-9c5b-421b-bfa6-0cb789870ef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:57.849753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac13b-9c5b-421b-bfa6-0cb789870ef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:57.850067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac13b-9c5b-421b-bfa6-0cb789870ef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:57.850346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ac13b-9c5b-421b-bfa6-0cb789870ef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:57.860635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ac13b-9c5b-421b-bfa6-0cb789870ef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:57.862118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ac13b-9c5b-421b-bfa6-0cb789870ef5 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:57.875507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1153/2330] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:58.160435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16c9f-b2a3-479c-b828-32cdbe420edf None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:58.162067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d4e16c9f-b2a3-479c-b828-32cdbe420edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:58.176155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e16c9f-b2a3-479c-b828-32cdbe420edf None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:58.181402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:58.182625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:58.182967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:58.183313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] PATH_INFO: `/v3/projects/304c8b10156348c39d7a8a7793a409df` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:58.184592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] RBAC: Authorizing `identity:delete_project(project_id=304c8b10156348c39d7a8a7793a409df)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:58.186785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:58.196150 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:58.237377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304c8b10156348c39d7a8a7793a409df', 'request_id': 'req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.249178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304c8b10156348c39d7a8a7793a409df', 'request_id': 'req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.255249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304c8b10156348c39d7a8a7793a409df', 'request_id': 'req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.267338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] The token cache is being invalidate because project 304c8b10156348c39d7a8a7793a409df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:58.267706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.268412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.270122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1178/2331] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:58 2022] DELETE /identity/v3/projects/304c8b10156348c39d7a8a7793a409df => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:46:58.274218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ac13b-9c5b-421b-bfa6-0cb789870ef5 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:58.284076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ac13b-9c5b-421b-bfa6-0cb789870ef5 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:58.336856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:58.343359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:58.344259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:58.344713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:58.345326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] PATH_INFO: `/v3/users/35d6e0bdc64a4f109d1cea57d9eff0f0` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:58.346560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d6e0bdc64a4f109d1cea57d9eff0f0)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:58.348887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:58.398127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d6e0bdc64a4f109d1cea57d9eff0f0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.398775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d6e0bdc64a4f109d1cea57d9eff0f0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.407121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d6e0bdc64a4f109d1cea57d9eff0f0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.414091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d6e0bdc64a4f109d1cea57d9eff0f0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.425872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8f35ffe6-b9f7-476d-a878-74c379d40a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d6e0bdc64a4f109d1cea57d9eff0f0'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.431724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1154/2332] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:46:58 2022] DELETE /identity/v3/users/35d6e0bdc64a4f109d1cea57d9eff0f0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:58.704813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:58.706460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:58.720305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39603c2-3dca-418d-9fe2-5f4b0fc4954a admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:58.780168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:58.780993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:58.781278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:58.781583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] PATH_INFO: `/v3/projects/8bb2127f81504705bfc18e28b41d4002` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:58.782812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb2127f81504705bfc18e28b41d4002)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:58.784731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:58.843749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb2127f81504705bfc18e28b41d4002', 'request_id': 'req-9934cc0b-6f11-4cb5-b04e-fa526db22182'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.852847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb2127f81504705bfc18e28b41d4002', 'request_id': 'req-9934cc0b-6f11-4cb5-b04e-fa526db22182'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.858578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb2127f81504705bfc18e28b41d4002', 'request_id': 'req-9934cc0b-6f11-4cb5-b04e-fa526db22182'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.869882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] The token cache is being invalidate because project 8bb2127f81504705bfc18e28b41d4002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:46:58.870252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.870985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9934cc0b-6f11-4cb5-b04e-fa526db22182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:46:58.872670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1179/2333] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:46:58 2022] DELETE /identity/v3/projects/8bb2127f81504705bfc18e28b41d4002 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:58.877823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceda0e9-9280-4f37-bdd2-337b1d02848c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:58.878350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceda0e9-9280-4f37-bdd2-337b1d02848c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:58.878503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceda0e9-9280-4f37-bdd2-337b1d02848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:58.896472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-fceda0e9-9280-4f37-bdd2-337b1d02848c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:58.897660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fceda0e9-9280-4f37-bdd2-337b1d02848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:58.961152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1155/2334] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:58.969071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeda74-527c-47da-bb7a-67836baf6a7c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:58.969363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeda74-527c-47da-bb7a-67836baf6a7c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:58.969646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adeda74-527c-47da-bb7a-67836baf6a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:58.988088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-3adeda74-527c-47da-bb7a-67836baf6a7c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:58.989271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3adeda74-527c-47da-bb7a-67836baf6a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:58.997421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1180/2335] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:59.001686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceda0e9-9280-4f37-bdd2-337b1d02848c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.012113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceda0e9-9280-4f37-bdd2-337b1d02848c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.017195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.018008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.018294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.018568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.019303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:46:59.019606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.021225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.033303 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1156/2336] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:46:59.037636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adeda74-527c-47da-bb7a-67836baf6a7c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.047179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adeda74-527c-47da-bb7a-67836baf6a7c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.052167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a6459-77f1-4c4c-a2ca-0d847794cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.052915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a6459-77f1-4c4c-a2ca-0d847794cf22 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.053202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a6459-77f1-4c4c-a2ca-0d847794cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.053483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a6459-77f1-4c4c-a2ca-0d847794cf22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.054223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a6459-77f1-4c4c-a2ca-0d847794cf22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.056149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a6459-77f1-4c4c-a2ca-0d847794cf22 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.077763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:59.086334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1181/2337] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:59 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:59.090188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.110948 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571939ce-4c4b-4bb7-bc36-d99c9adc8515 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.170155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f6be-4e4c-4169-9e68-8dbc4a962f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.170842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f6be-4e4c-4169-9e68-8dbc4a962f58 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.171128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f6be-4e4c-4169-9e68-8dbc4a962f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.171407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3f6be-4e4c-4169-9e68-8dbc4a962f58 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.172176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3f6be-4e4c-4169-9e68-8dbc4a962f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.174148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3f6be-4e4c-4169-9e68-8dbc4a962f58 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.182879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:59.198583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1157/2338] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:59 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:46:59.202427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a6459-77f1-4c4c-a2ca-0d847794cf22 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.212994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a6459-77f1-4c4c-a2ca-0d847794cf22 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.217749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70ecd-e93c-4491-95b5-57bcf61e6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.218440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70ecd-e93c-4491-95b5-57bcf61e6361 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.218727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70ecd-e93c-4491-95b5-57bcf61e6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.218982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70ecd-e93c-4491-95b5-57bcf61e6361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.219733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba70ecd-e93c-4491-95b5-57bcf61e6361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.221338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba70ecd-e93c-4491-95b5-57bcf61e6361 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.232320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1182/2339] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:59.236393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f6be-4e4c-4169-9e68-8dbc4a962f58 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.246872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3f6be-4e4c-4169-9e68-8dbc4a962f58 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.252151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66468794-3024-4168-aef6-37f501148fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.252810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66468794-3024-4168-aef6-37f501148fba admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.253093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66468794-3024-4168-aef6-37f501148fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.253349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66468794-3024-4168-aef6-37f501148fba admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.254123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66468794-3024-4168-aef6-37f501148fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.255728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66468794-3024-4168-aef6-37f501148fba admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.265933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1158/2340] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:59.270310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70ecd-e93c-4491-95b5-57bcf61e6361 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.280308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70ecd-e93c-4491-95b5-57bcf61e6361 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.285194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dddce0-93c2-42fb-957f-41b2bb847d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.286004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dddce0-93c2-42fb-957f-41b2bb847d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.286284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dddce0-93c2-42fb-957f-41b2bb847d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.286559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dddce0-93c2-42fb-957f-41b2bb847d4a admin admin] PATH_INFO: `/v3/projects/6a14e5e124c74443946f4f8a6c4616c5/users/6e07842885a541daa197e15fe68e1625/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.301922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dddce0-93c2-42fb-957f-41b2bb847d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a14e5e124c74443946f4f8a6c4616c5, user_id=6e07842885a541daa197e15fe68e1625, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.304616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dddce0-93c2-42fb-957f-41b2bb847d4a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.320251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1183/2341] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:59 2022] PUT /identity/v3/projects/6a14e5e124c74443946f4f8a6c4616c5/users/6e07842885a541daa197e15fe68e1625/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:59.331262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ada25-37f8-4d5f-b221-65a9f66f08b3 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.331523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ada25-37f8-4d5f-b221-65a9f66f08b3 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.331824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ada25-37f8-4d5f-b221-65a9f66f08b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.359001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bf0ada25-37f8-4d5f-b221-65a9f66f08b3 None None] MFA Rules not processed for user `6e07842885a541daa197e15fe68e1625`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:59.360232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bf0ada25-37f8-4d5f-b221-65a9f66f08b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:59.434542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1159/2342] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:46:59.439546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dddce0-93c2-42fb-957f-41b2bb847d4a admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.501640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dddce0-93c2-42fb-957f-41b2bb847d4a admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.507083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e4077-fb19-473a-a33d-1ba1a5d93cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.507769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e4077-fb19-473a-a33d-1ba1a5d93cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.508034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e4077-fb19-473a-a33d-1ba1a5d93cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.508349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e4077-fb19-473a-a33d-1ba1a5d93cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.508998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e4077-fb19-473a-a33d-1ba1a5d93cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.511067 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e4077-fb19-473a-a33d-1ba1a5d93cd4 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.539160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1184/2343] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:46:59 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:46:59.543481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ada25-37f8-4d5f-b221-65a9f66f08b3 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.554207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ada25-37f8-4d5f-b221-65a9f66f08b3 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.611960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a364e-4475-4247-b34f-efd441f5c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.612767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a364e-4475-4247-b34f-efd441f5c860 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.613058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a364e-4475-4247-b34f-efd441f5c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.613328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a364e-4475-4247-b34f-efd441f5c860 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.614060 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a364e-4475-4247-b34f-efd441f5c860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.616038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a364e-4475-4247-b34f-efd441f5c860 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.638468 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1160/2344] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:46:59 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:46:59.642689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e4077-fb19-473a-a33d-1ba1a5d93cd4 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.653278 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e4077-fb19-473a-a33d-1ba1a5d93cd4 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.658084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae799-68ca-402a-96ab-d87b4b4a9d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.658741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae799-68ca-402a-96ab-d87b4b4a9d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.659020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae799-68ca-402a-96ab-d87b4b4a9d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.659292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae799-68ca-402a-96ab-d87b4b4a9d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.660024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ae799-68ca-402a-96ab-d87b4b4a9d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.661625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ae799-68ca-402a-96ab-d87b4b4a9d83 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.673531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1185/2345] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:59.679594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a364e-4475-4247-b34f-efd441f5c860 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.693473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a364e-4475-4247-b34f-efd441f5c860 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.700114 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fc202-e823-48a7-a90b-faddb41ace9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.701045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fc202-e823-48a7-a90b-faddb41ace9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.701327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fc202-e823-48a7-a90b-faddb41ace9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.701599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fc202-e823-48a7-a90b-faddb41ace9c admin admin] PATH_INFO: `/v3/projects/df65d85cdb824b9fb3c342736e5a67c3/users/e23a8edc40ad4ccb9bd7f4c5789b9fbb/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.716242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fc202-e823-48a7-a90b-faddb41ace9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df65d85cdb824b9fb3c342736e5a67c3, user_id=e23a8edc40ad4ccb9bd7f4c5789b9fbb, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.718999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fc202-e823-48a7-a90b-faddb41ace9c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.734912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1161/2346] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:59 2022] PUT /identity/v3/projects/df65d85cdb824b9fb3c342736e5a67c3/users/e23a8edc40ad4ccb9bd7f4c5789b9fbb/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:59.739342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae799-68ca-402a-96ab-d87b4b4a9d83 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.749715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae799-68ca-402a-96ab-d87b4b4a9d83 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.811074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bda87-f20b-472a-9ed5-29938bd4d3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.811667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bda87-f20b-472a-9ed5-29938bd4d3da admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.811952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bda87-f20b-472a-9ed5-29938bd4d3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.812225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bda87-f20b-472a-9ed5-29938bd4d3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.812954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bda87-f20b-472a-9ed5-29938bd4d3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.814586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bda87-f20b-472a-9ed5-29938bd4d3da admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.827705 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1186/2347] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:46:59.832251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fc202-e823-48a7-a90b-faddb41ace9c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:46:59.843081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fc202-e823-48a7-a90b-faddb41ace9c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:46:59.848795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:46:59.849719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.849997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.850308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] PATH_INFO: `/v3/projects/df65d85cdb824b9fb3c342736e5a67c3/users/e23a8edc40ad4ccb9bd7f4c5789b9fbb/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.852361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df65d85cdb824b9fb3c342736e5a67c3, user_id=e23a8edc40ad4ccb9bd7f4c5789b9fbb, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:46:59.855067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:46:59.866093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1162/2348] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:46:59 2022] PUT /identity/v3/projects/df65d85cdb824b9fb3c342736e5a67c3/users/e23a8edc40ad4ccb9bd7f4c5789b9fbb/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:46:59.935773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958e74-a3ae-4835-889c-21e1593662ce None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:46:59.936076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958e74-a3ae-4835-889c-21e1593662ce None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:46:59.936996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36958e74-a3ae-4835-889c-21e1593662ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:46:59.966321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-36958e74-a3ae-4835-889c-21e1593662ce None None] MFA Rules not processed for user `e23a8edc40ad4ccb9bd7f4c5789b9fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:46:59.967567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-36958e74-a3ae-4835-889c-21e1593662ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:46:59.988120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:00.043788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1187/2349] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:46:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:00.054971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:00.056905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:00.088389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:00.122099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49005676-bd91-4f78-a537-6e0d5f477c10 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:00.126368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb88f98-d46f-466d-9e94-cb3d5c8a65f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:00.127059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88f98-d46f-466d-9e94-cb3d5c8a65f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:00.127343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88f98-d46f-466d-9e94-cb3d5c8a65f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:00.127613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88f98-d46f-466d-9e94-cb3d5c8a65f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:00.138142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb88f98-d46f-466d-9e94-cb3d5c8a65f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:00.139593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb88f98-d46f-466d-9e94-cb3d5c8a65f2 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:00.150021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1163/2350] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:00.531380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36958e74-a3ae-4835-889c-21e1593662ce None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:00.594029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36958e74-a3ae-4835-889c-21e1593662ce None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:00.598593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:00.599475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:00.599762 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:00.600045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] PATH_INFO: `/v3/users/6e07842885a541daa197e15fe68e1625` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:00.601212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e07842885a541daa197e15fe68e1625)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:00.603176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:00.652048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e07842885a541daa197e15fe68e1625'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:00.660138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e07842885a541daa197e15fe68e1625'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:00.660881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e07842885a541daa197e15fe68e1625'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:00.668112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e07842885a541daa197e15fe68e1625'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:00.680128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e07842885a541daa197e15fe68e1625'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:00.688573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1188/2351] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:47:00 2022] DELETE /identity/v3/users/6e07842885a541daa197e15fe68e1625 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:00.693084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e42a-0391-4e5d-a916-0110f9ad2ce5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:00.693380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e42a-0391-4e5d-a916-0110f9ad2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:00.693658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e42a-0391-4e5d-a916-0110f9ad2ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:00.712173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-9976e42a-0391-4e5d-a916-0110f9ad2ce5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:00.713370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9976e42a-0391-4e5d-a916-0110f9ad2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:00.773323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1164/2352] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:00.783571 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:00.785168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:00.835241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:00.852102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde71e76-51a7-4e01-8d98-74d470452b22 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:00.855686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2a7d6-37be-4a75-966a-820dece7299b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:00.856351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2a7d6-37be-4a75-966a-820dece7299b service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:00.856629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2a7d6-37be-4a75-966a-820dece7299b service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:00.856900 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2a7d6-37be-4a75-966a-820dece7299b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:00.865861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2a7d6-37be-4a75-966a-820dece7299b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:00.867329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f2a7d6-37be-4a75-966a-820dece7299b service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:00.877784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1189/2353] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:01.166640 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e42a-0391-4e5d-a916-0110f9ad2ce5 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:01.168291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9976e42a-0391-4e5d-a916-0110f9ad2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:01.181679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e42a-0391-4e5d-a916-0110f9ad2ce5 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:01.187567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:01.188344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:01.188693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:01.189069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] PATH_INFO: `/v3/projects/6a14e5e124c74443946f4f8a6c4616c5` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:01.190406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a14e5e124c74443946f4f8a6c4616c5)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:01.192454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:01.241210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a14e5e124c74443946f4f8a6c4616c5', 'request_id': 'req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.249720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a14e5e124c74443946f4f8a6c4616c5', 'request_id': 'req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.256583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a14e5e124c74443946f4f8a6c4616c5', 'request_id': 'req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.270620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] The token cache is being invalidate because project 6a14e5e124c74443946f4f8a6c4616c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:47:01.270911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.271565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.273911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1165/2354] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:47:01 2022] DELETE /identity/v3/projects/6a14e5e124c74443946f4f8a6c4616c5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:01.278545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2a7d6-37be-4a75-966a-820dece7299b service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:01.291913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2a7d6-37be-4a75-966a-820dece7299b service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:01.365906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:01.367459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:01.367933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:01.368218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] PATH_INFO: `/v3/users/e23a8edc40ad4ccb9bd7f4c5789b9fbb` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:01.369452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e23a8edc40ad4ccb9bd7f4c5789b9fbb)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:01.371651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:01.426614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e23a8edc40ad4ccb9bd7f4c5789b9fbb'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.437244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e23a8edc40ad4ccb9bd7f4c5789b9fbb'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.438121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e23a8edc40ad4ccb9bd7f4c5789b9fbb'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.446230 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e23a8edc40ad4ccb9bd7f4c5789b9fbb'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.460847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b92ea4be-77d1-4b34-9dc1-d64e9315756e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e23a8edc40ad4ccb9bd7f4c5789b9fbb'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:01.472031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1190/2355] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:47:01 2022] DELETE /identity/v3/users/e23a8edc40ad4ccb9bd7f4c5789b9fbb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:02.066964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.068658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:02.100597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8b814-0b7c-4265-b03a-8f4ceda75e0b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:02.152147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:02.165783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:02.166839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.167389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.167481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] PATH_INFO: `/v3/projects/df65d85cdb824b9fb3c342736e5a67c3` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.169129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df65d85cdb824b9fb3c342736e5a67c3)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:02.171092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:02.223055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df65d85cdb824b9fb3c342736e5a67c3', 'request_id': 'req-225a596c-566d-44ba-9e7f-cc0677b07de5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:02.233175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df65d85cdb824b9fb3c342736e5a67c3', 'request_id': 'req-225a596c-566d-44ba-9e7f-cc0677b07de5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:02.239431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df65d85cdb824b9fb3c342736e5a67c3', 'request_id': 'req-225a596c-566d-44ba-9e7f-cc0677b07de5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:02.251158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] The token cache is being invalidate because project df65d85cdb824b9fb3c342736e5a67c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:47:02.251446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:02.252113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-225a596c-566d-44ba-9e7f-cc0677b07de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:02.253666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1166/2356] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:47:02 2022] DELETE /identity/v3/projects/df65d85cdb824b9fb3c342736e5a67c3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:02.258743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78482e-f32f-4ea2-ac61-a8f2bddd14c6 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.259544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78482e-f32f-4ea2-ac61-a8f2bddd14c6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.260065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78482e-f32f-4ea2-ac61-a8f2bddd14c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.278910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ab78482e-f32f-4ea2-ac61-a8f2bddd14c6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:02.280158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ab78482e-f32f-4ea2-ac61-a8f2bddd14c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:02.333310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:02.349014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1191/2357] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:02.350812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352def-f70f-4bca-adfa-efd50c8c936d None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.351142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352def-f70f-4bca-adfa-efd50c8c936d None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.351472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00352def-f70f-4bca-adfa-efd50c8c936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.376656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-00352def-f70f-4bca-adfa-efd50c8c936d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:02.378176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-00352def-f70f-4bca-adfa-efd50c8c936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:02.386482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1167/2358] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:02.390883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78482e-f32f-4ea2-ac61-a8f2bddd14c6 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.401195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78482e-f32f-4ea2-ac61-a8f2bddd14c6 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:02.406069 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:02.406734 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.407016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.407294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.408032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:47:02.408341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:02.410002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:02.421780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1192/2359] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:47:02.426326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352def-f70f-4bca-adfa-efd50c8c936d None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.436038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00352def-f70f-4bca-adfa-efd50c8c936d None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:02.441926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73369205-0eb0-4c53-a982-2ab3750d538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:02.442628 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73369205-0eb0-4c53-a982-2ab3750d538f admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.442903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73369205-0eb0-4c53-a982-2ab3750d538f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.443171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73369205-0eb0-4c53-a982-2ab3750d538f admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.443862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73369205-0eb0-4c53-a982-2ab3750d538f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:02.446152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73369205-0eb0-4c53-a982-2ab3750d538f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:02.475788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1168/2360] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:47:02 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:47:02.481517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.491695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9b4bb-89d5-41b1-b8bb-435cab38ef06 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:02.550338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43f396-1600-41cf-85c7-ab88144b5e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:02.551004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f396-1600-41cf-85c7-ab88144b5e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.551284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f396-1600-41cf-85c7-ab88144b5e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.551557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43f396-1600-41cf-85c7-ab88144b5e9c admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.552256 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43f396-1600-41cf-85c7-ab88144b5e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:02.554239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43f396-1600-41cf-85c7-ab88144b5e9c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:02.580939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1193/2361] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:47:02 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:47:02.585304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73369205-0eb0-4c53-a982-2ab3750d538f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.596123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73369205-0eb0-4c53-a982-2ab3750d538f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:02.602315 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cb31d-50a7-4d5d-91ee-b231bda7c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:02.603167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb31d-50a7-4d5d-91ee-b231bda7c91b admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.603452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb31d-50a7-4d5d-91ee-b231bda7c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.603737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cb31d-50a7-4d5d-91ee-b231bda7c91b admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.604464 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cb31d-50a7-4d5d-91ee-b231bda7c91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:02.606119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cb31d-50a7-4d5d-91ee-b231bda7c91b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:02.617379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1169/2362] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:47:02.621750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43f396-1600-41cf-85c7-ab88144b5e9c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.633836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43f396-1600-41cf-85c7-ab88144b5e9c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:02.640353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab7536-728b-4b42-bd1f-cd790850243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:02.641034 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab7536-728b-4b42-bd1f-cd790850243a admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.641306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab7536-728b-4b42-bd1f-cd790850243a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.641557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab7536-728b-4b42-bd1f-cd790850243a admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.642326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab7536-728b-4b42-bd1f-cd790850243a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:02.643917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab7536-728b-4b42-bd1f-cd790850243a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:02.654599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1194/2363] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:47:02.658941 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cb31d-50a7-4d5d-91ee-b231bda7c91b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.669356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cb31d-50a7-4d5d-91ee-b231bda7c91b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:02.674828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30eefe-4641-43ef-8f47-0ceffe5faba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:02.675648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30eefe-4641-43ef-8f47-0ceffe5faba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.675926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30eefe-4641-43ef-8f47-0ceffe5faba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.676199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30eefe-4641-43ef-8f47-0ceffe5faba3 admin admin] PATH_INFO: `/v3/projects/7f9e9129155e43eb803cec3220cb5fe8/users/1439fbf237ae4ac4923ff4af964d6bad/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.697225 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30eefe-4641-43ef-8f47-0ceffe5faba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9e9129155e43eb803cec3220cb5fe8, user_id=1439fbf237ae4ac4923ff4af964d6bad, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:02.700105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30eefe-4641-43ef-8f47-0ceffe5faba3 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:02.715428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1170/2364] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:47:02 2022] PUT /identity/v3/projects/7f9e9129155e43eb803cec3220cb5fe8/users/1439fbf237ae4ac4923ff4af964d6bad/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:02.726160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790dca-5d8c-4410-927c-fc2f0723d986 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.726450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790dca-5d8c-4410-927c-fc2f0723d986 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.726726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3790dca-5d8c-4410-927c-fc2f0723d986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.752917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d3790dca-5d8c-4410-927c-fc2f0723d986 None None] MFA Rules not processed for user `1439fbf237ae4ac4923ff4af964d6bad`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:02.754183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d3790dca-5d8c-4410-927c-fc2f0723d986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:02.820595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1195/2365] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:47:02.826350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30eefe-4641-43ef-8f47-0ceffe5faba3 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.894423 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30eefe-4641-43ef-8f47-0ceffe5faba3 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:02.899650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cf887-89cb-46e9-b99d-4bd9f602a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:02.900292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf887-89cb-46e9-b99d-4bd9f602a97f admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:02.900571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf887-89cb-46e9-b99d-4bd9f602a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:02.900845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177cf887-89cb-46e9-b99d-4bd9f602a97f admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:02.901530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cf887-89cb-46e9-b99d-4bd9f602a97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:02.903477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177cf887-89cb-46e9-b99d-4bd9f602a97f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:02.931581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1171/2366] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:47:02 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:47:02.935996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3790dca-5d8c-4410-927c-fc2f0723d986 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:02.949043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3790dca-5d8c-4410-927c-fc2f0723d986 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:03.000400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:03.008335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b4895-989c-4c41-ba40-bb9952f35396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:03.009146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b4895-989c-4c41-ba40-bb9952f35396 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.009433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b4895-989c-4c41-ba40-bb9952f35396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.009713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b4895-989c-4c41-ba40-bb9952f35396 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.010485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b4895-989c-4c41-ba40-bb9952f35396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:03.012489 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b4895-989c-4c41-ba40-bb9952f35396 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:03.033878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1196/2367] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:47:02 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:47:03.038187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cf887-89cb-46e9-b99d-4bd9f602a97f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:03.043896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:03.050969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177cf887-89cb-46e9-b99d-4bd9f602a97f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:03.057575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82689bb9-5bea-405a-b9b4-ee71e5493ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:03.058367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82689bb9-5bea-405a-b9b4-ee71e5493ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.058655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82689bb9-5bea-405a-b9b4-ee71e5493ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.058938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82689bb9-5bea-405a-b9b4-ee71e5493ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.059675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82689bb9-5bea-405a-b9b4-ee71e5493ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:03.061294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82689bb9-5bea-405a-b9b4-ee71e5493ee9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:03.072717 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1172/2368] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:47:03.077246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b4895-989c-4c41-ba40-bb9952f35396 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:03.087508 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b4895-989c-4c41-ba40-bb9952f35396 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:03.092431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99291e3-de49-4aed-b0a2-26689a6cc244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:03.093320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99291e3-de49-4aed-b0a2-26689a6cc244 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.093622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99291e3-de49-4aed-b0a2-26689a6cc244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.093913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99291e3-de49-4aed-b0a2-26689a6cc244 admin admin] PATH_INFO: `/v3/projects/c13fac08ce2f4b1ead7d1e4508873128/users/f07ac489a9784d4fbd0dea7dc54d84ee/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.108497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99291e3-de49-4aed-b0a2-26689a6cc244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13fac08ce2f4b1ead7d1e4508873128, user_id=f07ac489a9784d4fbd0dea7dc54d84ee, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:03.111204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99291e3-de49-4aed-b0a2-26689a6cc244 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:03.126364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1197/2369] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:47:03 2022] PUT /identity/v3/projects/c13fac08ce2f4b1ead7d1e4508873128/users/f07ac489a9784d4fbd0dea7dc54d84ee/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:03.130650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82689bb9-5bea-405a-b9b4-ee71e5493ee9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:03.142230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82689bb9-5bea-405a-b9b4-ee71e5493ee9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:03.202957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e7e83-697f-441a-b9e7-e1a50400d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:03.203613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7e83-697f-441a-b9e7-e1a50400d081 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.203794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7e83-697f-441a-b9e7-e1a50400d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.204084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e7e83-697f-441a-b9e7-e1a50400d081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.204811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e7e83-697f-441a-b9e7-e1a50400d081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:03.206567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e7e83-697f-441a-b9e7-e1a50400d081 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:03.216968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1173/2370] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:47:03.221458 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99291e3-de49-4aed-b0a2-26689a6cc244 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:03.231950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99291e3-de49-4aed-b0a2-26689a6cc244 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:03.236855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:03.237739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.238055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.238337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] PATH_INFO: `/v3/projects/c13fac08ce2f4b1ead7d1e4508873128/users/f07ac489a9784d4fbd0dea7dc54d84ee/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.240415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13fac08ce2f4b1ead7d1e4508873128, user_id=f07ac489a9784d4fbd0dea7dc54d84ee, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:03.243116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:03.253821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1198/2371] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:47:03 2022] PUT /identity/v3/projects/c13fac08ce2f4b1ead7d1e4508873128/users/f07ac489a9784d4fbd0dea7dc54d84ee/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:03.265575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ae4f-33e1-484e-a7bb-425a01fb3d59 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.265862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ae4f-33e1-484e-a7bb-425a01fb3d59 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.266155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ae4f-33e1-484e-a7bb-425a01fb3d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.295066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ad12ae4f-33e1-484e-a7bb-425a01fb3d59 None None] MFA Rules not processed for user `f07ac489a9784d4fbd0dea7dc54d84ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:03.296340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ad12ae4f-33e1-484e-a7bb-425a01fb3d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:03.365421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1174/2372] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:03.378972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:03.380884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:03.441600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128fda3-6ae2-490f-a90a-a94b181449b9 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:03.446324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0526e0-48f4-4155-bbb5-0979c993b26f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:03.446971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0526e0-48f4-4155-bbb5-0979c993b26f service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.447255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0526e0-48f4-4155-bbb5-0979c993b26f service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.447532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0526e0-48f4-4155-bbb5-0979c993b26f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.457050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0526e0-48f4-4155-bbb5-0979c993b26f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:03.458556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0526e0-48f4-4155-bbb5-0979c993b26f service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:03.468183 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1199/2373] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:03.541388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ae4f-33e1-484e-a7bb-425a01fb3d59 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:03.551888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ae4f-33e1-484e-a7bb-425a01fb3d59 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:03.556633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3a398-0121-4f2b-b333-e9b35ecd9612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:03.557277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a398-0121-4f2b-b333-e9b35ecd9612 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.557557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a398-0121-4f2b-b333-e9b35ecd9612 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.557829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3a398-0121-4f2b-b333-e9b35ecd9612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.626864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3a398-0121-4f2b-b333-e9b35ecd9612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:03.628322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3a398-0121-4f2b-b333-e9b35ecd9612 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:03.637856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1175/2374] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:03.909971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0526e0-48f4-4155-bbb5-0979c993b26f service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:03.973653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0526e0-48f4-4155-bbb5-0979c993b26f service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:03.979996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:03.981258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:03.981543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:03.981787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] PATH_INFO: `/v3/users/1439fbf237ae4ac4923ff4af964d6bad` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:03.983484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1439fbf237ae4ac4923ff4af964d6bad)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:03.986617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:04.043724 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1439fbf237ae4ac4923ff4af964d6bad'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.048714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:04.055327 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1439fbf237ae4ac4923ff4af964d6bad'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.055984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1439fbf237ae4ac4923ff4af964d6bad'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.064984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1439fbf237ae4ac4923ff4af964d6bad'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.077624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1439fbf237ae4ac4923ff4af964d6bad'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.084197 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1200/2375] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:47:03 2022] DELETE /identity/v3/users/1439fbf237ae4ac4923ff4af964d6bad => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:04.088871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a31cf-21a4-4e38-bf43-cf9200ecb906 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:04.089159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a31cf-21a4-4e38-bf43-cf9200ecb906 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:04.089434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a31cf-21a4-4e38-bf43-cf9200ecb906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:04.106890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-2e9a31cf-21a4-4e38-bf43-cf9200ecb906 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:04.108134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2e9a31cf-21a4-4e38-bf43-cf9200ecb906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:04.113268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=100 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:04.170010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1176/2376] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:04.181703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:04.183418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:04.242547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374282c-0e18-498b-891d-ca819bc8a839 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:04.246934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9532d80-8170-400d-abc9-4979d0d40566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:04.247580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9532d80-8170-400d-abc9-4979d0d40566 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:04.247864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9532d80-8170-400d-abc9-4979d0d40566 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:04.248145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9532d80-8170-400d-abc9-4979d0d40566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:04.258344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9532d80-8170-400d-abc9-4979d0d40566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:04.259784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9532d80-8170-400d-abc9-4979d0d40566 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:04.269623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1201/2377] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:04.554568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a31cf-21a4-4e38-bf43-cf9200ecb906 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:04.556124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2e9a31cf-21a4-4e38-bf43-cf9200ecb906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:04.569134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a31cf-21a4-4e38-bf43-cf9200ecb906 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:04.575158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:04.576785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:04.577620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:04.578079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] PATH_INFO: `/v3/projects/7f9e9129155e43eb803cec3220cb5fe8` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:04.579705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9e9129155e43eb803cec3220cb5fe8)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:04.582145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:04.631757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9e9129155e43eb803cec3220cb5fe8', 'request_id': 'req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.640635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9e9129155e43eb803cec3220cb5fe8', 'request_id': 'req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.646270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9e9129155e43eb803cec3220cb5fe8', 'request_id': 'req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.657455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] The token cache is being invalidate because project 7f9e9129155e43eb803cec3220cb5fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:47:04.657741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.658363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.659927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1177/2378] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:47:04 2022] DELETE /identity/v3/projects/7f9e9129155e43eb803cec3220cb5fe8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:04.664288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9532d80-8170-400d-abc9-4979d0d40566 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:04.674426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9532d80-8170-400d-abc9-4979d0d40566 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:04.740093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:04.741365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:04.741777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:04.742235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] PATH_INFO: `/v3/users/f07ac489a9784d4fbd0dea7dc54d84ee` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:04.744470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07ac489a9784d4fbd0dea7dc54d84ee)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:04.746937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:04.806314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07ac489a9784d4fbd0dea7dc54d84ee'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.816695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07ac489a9784d4fbd0dea7dc54d84ee'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.817502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07ac489a9784d4fbd0dea7dc54d84ee'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.824943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07ac489a9784d4fbd0dea7dc54d84ee'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.832914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:04.838333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0e22a5d9-2a34-43d3-b1e2-9732034e257f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07ac489a9784d4fbd0dea7dc54d84ee'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:04.845272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1202/2379] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:47:04 2022] DELETE /identity/v3/users/f07ac489a9784d4fbd0dea7dc54d84ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:05.125736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:05.127194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:05.144758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673571a6-8d30-42d6-9dd0-e4c2730a3ecc admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:05.216832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:05.217760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.218058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.218342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] PATH_INFO: `/v3/projects/c13fac08ce2f4b1ead7d1e4508873128` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.219567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13fac08ce2f4b1ead7d1e4508873128)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:05.221529 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:05.266426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:05.276827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13fac08ce2f4b1ead7d1e4508873128', 'request_id': 'req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:05.286347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13fac08ce2f4b1ead7d1e4508873128', 'request_id': 'req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:05.292450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13fac08ce2f4b1ead7d1e4508873128', 'request_id': 'req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:05.303951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] The token cache is being invalidate because project c13fac08ce2f4b1ead7d1e4508873128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:47:05.304238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:05.304972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-43d6aee5-4cc9-41f9-8d8c-fe5bc1c1f262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:05.306638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1178/2380] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:47:05 2022] DELETE /identity/v3/projects/c13fac08ce2f4b1ead7d1e4508873128 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:05.312778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c39f9-4268-46ad-8897-b894b6cefc0d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.312978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c39f9-4268-46ad-8897-b894b6cefc0d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.313323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c39f9-4268-46ad-8897-b894b6cefc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.337921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2e2c39f9-4268-46ad-8897-b894b6cefc0d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:05.339202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2e2c39f9-4268-46ad-8897-b894b6cefc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:05.402096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1203/2381] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:05.410416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724339-7444-47d6-ae58-0ef717532eb6 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.410781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724339-7444-47d6-ae58-0ef717532eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.411068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68724339-7444-47d6-ae58-0ef717532eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.429710 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-68724339-7444-47d6-ae58-0ef717532eb6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:05.430925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-68724339-7444-47d6-ae58-0ef717532eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:05.439259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1179/2382] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:05.443532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c39f9-4268-46ad-8897-b894b6cefc0d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:05.453802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c39f9-4268-46ad-8897-b894b6cefc0d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:05.458989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:05.459640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.459921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.460176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.460917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:47:05.461216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:05.462864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:05.474690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1204/2383] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:47:05.478942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724339-7444-47d6-ae58-0ef717532eb6 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:05.489258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68724339-7444-47d6-ae58-0ef717532eb6 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:05.495446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31e86-d4e8-44ec-bb0e-a4f077da9641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:05.496107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31e86-d4e8-44ec-bb0e-a4f077da9641 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.496493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31e86-d4e8-44ec-bb0e-a4f077da9641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.496768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc31e86-d4e8-44ec-bb0e-a4f077da9641 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.497493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc31e86-d4e8-44ec-bb0e-a4f077da9641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:05.499460 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc31e86-d4e8-44ec-bb0e-a4f077da9641 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:05.529393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1180/2384] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:47:05 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:47:05.534028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:05.544173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525ea02-5897-4e2c-800a-b1df2fc42c24 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:05.603992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa164e18-b49c-419e-a111-c90a6621940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:05.604588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa164e18-b49c-419e-a111-c90a6621940f admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.604871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa164e18-b49c-419e-a111-c90a6621940f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.605148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa164e18-b49c-419e-a111-c90a6621940f admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.605838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa164e18-b49c-419e-a111-c90a6621940f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:05.607796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa164e18-b49c-419e-a111-c90a6621940f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:05.631212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1205/2385] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:47:05 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:47:05.635499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31e86-d4e8-44ec-bb0e-a4f077da9641 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:05.646152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc31e86-d4e8-44ec-bb0e-a4f077da9641 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:05.651219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c0ec-bcce-489b-8a15-3d04468b03fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:05.651876 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c0ec-bcce-489b-8a15-3d04468b03fb admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.652154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c0ec-bcce-489b-8a15-3d04468b03fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.652455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6c0ec-bcce-489b-8a15-3d04468b03fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.653188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c0ec-bcce-489b-8a15-3d04468b03fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:05.654855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6c0ec-bcce-489b-8a15-3d04468b03fb admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:05.665346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1181/2386] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:47:05.669593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa164e18-b49c-419e-a111-c90a6621940f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:05.680478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa164e18-b49c-419e-a111-c90a6621940f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:05.685291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddd358-9649-4c39-ba3e-c5da1a0496df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:05.685922 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd358-9649-4c39-ba3e-c5da1a0496df admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.686240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd358-9649-4c39-ba3e-c5da1a0496df admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.686559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd358-9649-4c39-ba3e-c5da1a0496df admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.687294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddd358-9649-4c39-ba3e-c5da1a0496df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:05.688893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eddd358-9649-4c39-ba3e-c5da1a0496df admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:05.699233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1206/2387] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:47:05.703442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c0ec-bcce-489b-8a15-3d04468b03fb admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:05.713864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6c0ec-bcce-489b-8a15-3d04468b03fb admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:05.718888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:05.719779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.720063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.720324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] PATH_INFO: `/v3/projects/f580554d21b04b08854633e418137555/users/66d9d08cbf604288b1ebcfd9fc0e2a3b/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.735339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f580554d21b04b08854633e418137555, user_id=66d9d08cbf604288b1ebcfd9fc0e2a3b, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:05.738043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:05.752708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1182/2388] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:47:05 2022] PUT /identity/v3/projects/f580554d21b04b08854633e418137555/users/66d9d08cbf604288b1ebcfd9fc0e2a3b/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:05.764693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cf0d0-3488-43e1-ae8e-9b058a5ec4fd None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.764987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cf0d0-3488-43e1-ae8e-9b058a5ec4fd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.765270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cf0d0-3488-43e1-ae8e-9b058a5ec4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.792089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f11cf0d0-3488-43e1-ae8e-9b058a5ec4fd None None] MFA Rules not processed for user `66d9d08cbf604288b1ebcfd9fc0e2a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:05.793363 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f11cf0d0-3488-43e1-ae8e-9b058a5ec4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:05.847403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:05.868936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1207/2389] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:47:05.880417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:05.882568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:05.944025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f87b50-7556-4841-b5c6-17c6015ebe16 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:05.948477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ad281-a4a0-4dd4-a953-9f6e0653973d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:05.949118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad281-a4a0-4dd4-a953-9f6e0653973d service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:05.949466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad281-a4a0-4dd4-a953-9f6e0653973d service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:05.949741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ad281-a4a0-4dd4-a953-9f6e0653973d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:05.959166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ad281-a4a0-4dd4-a953-9f6e0653973d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:05.960604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ad281-a4a0-4dd4-a953-9f6e0653973d service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:05.970345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1183/2390] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:08.541153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cf0d0-3488-43e1-ae8e-9b058a5ec4fd None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:08.605666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cf0d0-3488-43e1-ae8e-9b058a5ec4fd None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:08.612726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:08.613937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:08.614249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:08.614549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] PATH_INFO: `/v3/users/66d9d08cbf604288b1ebcfd9fc0e2a3b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:08.616537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d9d08cbf604288b1ebcfd9fc0e2a3b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:08.619576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:08.677643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d9d08cbf604288b1ebcfd9fc0e2a3b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:08.688151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d9d08cbf604288b1ebcfd9fc0e2a3b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:08.689078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d9d08cbf604288b1ebcfd9fc0e2a3b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:08.696564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d9d08cbf604288b1ebcfd9fc0e2a3b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:08.709214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d9d08cbf604288b1ebcfd9fc0e2a3b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:08.715460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1208/2391] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:47:08 2022] DELETE /identity/v3/users/66d9d08cbf604288b1ebcfd9fc0e2a3b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:08.720240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6c27-f0ff-401e-b254-d0dac26e629f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:08.720763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6c27-f0ff-401e-b254-d0dac26e629f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:08.720763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b6c27-f0ff-401e-b254-d0dac26e629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:08.739076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3d8b6c27-f0ff-401e-b254-d0dac26e629f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:47:08.740276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3d8b6c27-f0ff-401e-b254-d0dac26e629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:08.803930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1184/2392] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:47:08.814050 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:08.815681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:08.875168 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d1d5-943c-4ce4-9585-8807409478ea admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:08.879167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33b36-1407-4be6-aab1-b1e4eba19120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:08.879813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33b36-1407-4be6-aab1-b1e4eba19120 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:08.880096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33b36-1407-4be6-aab1-b1e4eba19120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:08.880367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce33b36-1407-4be6-aab1-b1e4eba19120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:08.889774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce33b36-1407-4be6-aab1-b1e4eba19120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:08.892265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce33b36-1407-4be6-aab1-b1e4eba19120 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:08.911844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1209/2393] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:09.202645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b6c27-f0ff-401e-b254-d0dac26e629f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:09.204247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3d8b6c27-f0ff-401e-b254-d0dac26e629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:09.215567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:09.219994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b6c27-f0ff-401e-b254-d0dac26e629f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:09.227433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:09.228408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:09.228701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:09.229023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] PATH_INFO: `/v3/projects/f580554d21b04b08854633e418137555` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:09.230478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f580554d21b04b08854633e418137555)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:09.232682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:09.280937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f580554d21b04b08854633e418137555', 'request_id': 'req-a9135581-3388-4d80-99cc-00e1ce20b010'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:09.289673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f580554d21b04b08854633e418137555', 'request_id': 'req-a9135581-3388-4d80-99cc-00e1ce20b010'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:09.295362 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f580554d21b04b08854633e418137555', 'request_id': 'req-a9135581-3388-4d80-99cc-00e1ce20b010'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:09.306196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] The token cache is being invalidate because project f580554d21b04b08854633e418137555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:47:09.306485 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:09.307126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:09.308719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1185/2394] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:47:09 2022] DELETE /identity/v3/projects/f580554d21b04b08854633e418137555 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:18.907476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:19.303296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:33.967128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33b36-1407-4be6-aab1-b1e4eba19120 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:33.976439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce33b36-1407-4be6-aab1-b1e4eba19120 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:34.026886 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:34.027520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:34.027806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:34.028088 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:34.030093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:34.091482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:34.092915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:34.102139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1210/2395] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:39.118819 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:39.120575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:39.134038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9135581-3388-4d80-99cc-00e1ce20b010 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:39.137774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:39.138545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:39.138816 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:39.139096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:39.140886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:39.210920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:39.212396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:39.222644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1186/2396] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:47:44.097818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=48 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:45.378484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:45.379977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:45.394973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6fa2d-3539-406a-b4f3-0f5844661d92 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:45.400085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:45.401045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:45.401326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:45.401582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] PATH_INFO: `/v3/users/44e3430faccb4db28f9439ac4e13cf26` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:45.402816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e3430faccb4db28f9439ac4e13cf26)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:45.404768 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:45.461273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e3430faccb4db28f9439ac4e13cf26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.470066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e3430faccb4db28f9439ac4e13cf26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.470837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e3430faccb4db28f9439ac4e13cf26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.477726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e3430faccb4db28f9439ac4e13cf26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.490312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e3430faccb4db28f9439ac4e13cf26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.496522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1211/2397] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:47:45 2022] DELETE /identity/v3/users/44e3430faccb4db28f9439ac4e13cf26 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:45.681899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:45.693347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00681227-78c2-408c-8ab5-72783963a7cd service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:45.769478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:45.770420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:45.770695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:45.770964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] PATH_INFO: `/v3/projects/c1d1142c18b54c03a1106fb2d1f1b7ec` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:45.772164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d1142c18b54c03a1106fb2d1f1b7ec)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:45.774159 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:45.829191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'request_id': 'req-d10b53a5-6e89-4807-be7b-b824c720a456'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.837856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'request_id': 'req-d10b53a5-6e89-4807-be7b-b824c720a456'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.843513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d1142c18b54c03a1106fb2d1f1b7ec', 'request_id': 'req-d10b53a5-6e89-4807-be7b-b824c720a456'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.854562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] The token cache is being invalidate because project c1d1142c18b54c03a1106fb2d1f1b7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:47:45.854791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.855412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:45.856980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1187/2398] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:47:45 2022] DELETE /identity/v3/projects/c1d1142c18b54c03a1106fb2d1f1b7ec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:45.860993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:45.862530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:45.875533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf6f78-8f4c-473a-b96e-8c11adf13224 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:45.943846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:45.944727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:45.945003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:45.945282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] PATH_INFO: `/v3/users/e06730e5fcb6416286b0cc7ee82d3308` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:45.946915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06730e5fcb6416286b0cc7ee82d3308)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:45.948862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:45.996937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06730e5fcb6416286b0cc7ee82d3308'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.005581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06730e5fcb6416286b0cc7ee82d3308'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.006246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06730e5fcb6416286b0cc7ee82d3308'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.013557 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06730e5fcb6416286b0cc7ee82d3308'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.021223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:46.026310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e24b0ea3-e429-49db-a750-db3a67943bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06730e5fcb6416286b0cc7ee82d3308'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.033117 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1212/2399] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:47:45 2022] DELETE /identity/v3/users/e06730e5fcb6416286b0cc7ee82d3308 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:47:46.215044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:47:46.216572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:47:46.231013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b53a5-6e89-4807-be7b-b824c720a456 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:47:46.255523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:46.294269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:47:46.295176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:47:46.295458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:47:46.295735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] PATH_INFO: `/v3/projects/d7aa7c0318a1495e88eea54a51d4862a` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:47:46.296942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7aa7c0318a1495e88eea54a51d4862a)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:47:46.298900 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:47:46.346849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7aa7c0318a1495e88eea54a51d4862a', 'request_id': 'req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.356455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7aa7c0318a1495e88eea54a51d4862a', 'request_id': 'req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.362039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7aa7c0318a1495e88eea54a51d4862a', 'request_id': 'req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.373977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] The token cache is being invalidate because project d7aa7c0318a1495e88eea54a51d4862a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:47:46.374328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.375013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:47:46.376867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1188/2400] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:47:46 2022] DELETE /identity/v3/projects/d7aa7c0318a1495e88eea54a51d4862a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:47:56.032794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:56.370572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:03.732378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d97e9-c441-4262-8a2a-512b82fc363d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:03.733003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d97e9-c441-4262-8a2a-512b82fc363d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:03.733385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d97e9-c441-4262-8a2a-512b82fc363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:03.752818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-924d97e9-c441-4262-8a2a-512b82fc363d None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:48:03.754218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-924d97e9-c441-4262-8a2a-512b82fc363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:03.825964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1213/2401] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:48:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:48:03.882147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:48:03.883783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:03.964493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890f9d8-4f50-4a5b-86d1-91521fd4cdca admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:48:03.969761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:48:03.970883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:03.971402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:03.971889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:03.981317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:48:03.982969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:48:03.991831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1189/2402] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:48:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:48:04.288253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ead57-7eff-4d10-8543-f78a27a90d59 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:04.288806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ead57-7eff-4d10-8543-f78a27a90d59 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:04.289078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ead57-7eff-4d10-8543-f78a27a90d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:04.308325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-416ead57-7eff-4d10-8543-f78a27a90d59 None None] MFA Rules not processed for user `3229929e0f2f4c9fbb3dc6413b6db151`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:48:04.309739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-416ead57-7eff-4d10-8543-f78a27a90d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:04.379643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1214/2403] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:48:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:48:13.989586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=32 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:14.370409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=50 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:19.307407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:48:19.309012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:19.368631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b14fa3-5f6c-4548-b0c2-dc7644bddeb1 service swift] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:48:19.372905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01200bb6-4e44-4bf5-97e3-d20e60c22f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:48:19.373571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200bb6-4e44-4bf5-97e3-d20e60c22f8b service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:19.373853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200bb6-4e44-4bf5-97e3-d20e60c22f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:19.374160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01200bb6-4e44-4bf5-97e3-d20e60c22f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:19.376177 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-01200bb6-4e44-4bf5-97e3-d20e60c22f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:19.461364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200bb6-4e44-4bf5-97e3-d20e60c22f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:48:19.463173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01200bb6-4e44-4bf5-97e3-d20e60c22f8b service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:48:19.479333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1190/2404] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:48:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:48:21.784280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ead57-7eff-4d10-8543-f78a27a90d59 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:48:21.794582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ead57-7eff-4d10-8543-f78a27a90d59 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:48:21.798552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:48:21.799196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:21.799478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:21.799749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:21.801657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:21.816477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:48:21.817927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:48:21.830128 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1215/2405] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:48:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:48:22.524181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9d3d-133f-4d47-bd0a-d2b1839e0e49 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:22.524716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9d3d-133f-4d47-bd0a-d2b1839e0e49 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:22.524716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b9d3d-133f-4d47-bd0a-d2b1839e0e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:22.544029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-cd1b9d3d-133f-4d47-bd0a-d2b1839e0e49 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:48:22.545239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cd1b9d3d-133f-4d47-bd0a-d2b1839e0e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:22.554723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1191/2406] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:48:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:48:22.566950 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:48:22.578798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adbba3-5daa-475b-a0bc-2f5b67260eb7 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:48:22.584285 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:48:22.584919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:22.585204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:22.585481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:22.594242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:48:22.596454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:48:22.609275 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1216/2407] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:48:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:48:30.926693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9d3d-133f-4d47-bd0a-d2b1839e0e49 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:48:30.928364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cd1b9d3d-133f-4d47-bd0a-d2b1839e0e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:30.946130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b9d3d-133f-4d47-bd0a-d2b1839e0e49 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:48:30.953413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f198f-97ef-4b59-9be6-6b35438d752c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:48:30.954209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f198f-97ef-4b59-9be6-6b35438d752c service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:30.954465 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f198f-97ef-4b59-9be6-6b35438d752c service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:30.954766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f198f-97ef-4b59-9be6-6b35438d752c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:30.956917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-421f198f-97ef-4b59-9be6-6b35438d752c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:31.053056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f198f-97ef-4b59-9be6-6b35438d752c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:48:31.055067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f198f-97ef-4b59-9be6-6b35438d752c service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:48:31.076910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1192/2408] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:48:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:48:32.604121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=12 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:41.074436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:42.335690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:48:42.338015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:42.356322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b8177-b06e-4968-9d1a-484a1d9c3c92 service swift] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:48:42.363435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:48:42.364073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:42.364348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:42.364628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:42.366584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:42.450902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:48:42.452588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:48:42.472902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1217/2409] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:48:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:48:43.040737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635c90-d055-488e-940d-05f46ee8a8d9 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:43.041270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635c90-d055-488e-940d-05f46ee8a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:43.041270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f635c90-d055-488e-940d-05f46ee8a8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:43.059626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-9f635c90-d055-488e-940d-05f46ee8a8d9 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:48:43.060885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9f635c90-d055-488e-940d-05f46ee8a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:48:43.069150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1193/2410] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jul 1 19:48:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:48:43.082990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:48:43.098200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9119aa-f560-4e07-beb0-bd206e3bf25b service nova] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:48:43.104216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:48:43.104862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:48:43.105191 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:48:43.105472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:48:43.114652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:48:43.116250 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:48:43.124797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1218/2411] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:48:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:48:53.055563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:48:53.121331 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=47 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:07.398123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f635c90-d055-488e-940d-05f46ee8a8d9 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:07.408430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f635c90-d055-488e-940d-05f46ee8a8d9 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:07.412753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:07.413409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:07.413691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:07.413980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:07.415931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:07.482023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:07.483459 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:07.493709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1194/2412] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:10.635494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:10.637027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:10.702017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:10.704102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:10.716537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178874-35eb-44ee-bad2-861d11b8b6cc service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:10.717906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce7ee6-ba4d-413f-8dc2-f552ba9ca435 service swift] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:10.721479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:10.722625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:10.722977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:10.723100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:10.723379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] PATH_INFO: `/v3/users/c4167eeb95ca4a95a7db1c8e2491a411` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:10.723623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:10.723907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:10.724178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:10.724763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4167eeb95ca4a95a7db1c8e2491a411)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:10.725920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:10.726957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:10.737430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:10.743143 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:10.755192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1219/2413] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:10.778647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4167eeb95ca4a95a7db1c8e2491a411'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:10.779348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4167eeb95ca4a95a7db1c8e2491a411'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:10.790673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4167eeb95ca4a95a7db1c8e2491a411'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:10.797703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4167eeb95ca4a95a7db1c8e2491a411'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:10.811425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d5737b19-f593-48ee-b9f8-1f02f24e9ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4167eeb95ca4a95a7db1c8e2491a411'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:10.818181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1195/2414] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:10 2022] DELETE /identity/v3/users/c4167eeb95ca4a95a7db1c8e2491a411 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:10.996329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:11.009146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46041e-d255-4505-9a67-d8717e436cba service placement] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:11.073343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:11.074190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.074501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.074780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] PATH_INFO: `/v3/projects/21155f0418884af191e3e7981904730c` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.076033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21155f0418884af191e3e7981904730c)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:11.077967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:11.126021 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21155f0418884af191e3e7981904730c', 'request_id': 'req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:11.136138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21155f0418884af191e3e7981904730c', 'request_id': 'req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:11.143708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21155f0418884af191e3e7981904730c', 'request_id': 'req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:11.156139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] The token cache is being invalidate because project 21155f0418884af191e3e7981904730c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:11.156430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:11.157163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-2cb2e3c8-f1a3-4327-82fc-5031ccd10ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:11.158948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1220/2415] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:10 2022] DELETE /identity/v3/projects/21155f0418884af191e3e7981904730c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:11.164471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13805b3-b634-4ba8-8540-1d2b4d1e4731 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.164769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13805b3-b634-4ba8-8540-1d2b4d1e4731 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.165036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13805b3-b634-4ba8-8540-1d2b4d1e4731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.185236 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a13805b3-b634-4ba8-8540-1d2b4d1e4731 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:11.186489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a13805b3-b634-4ba8-8540-1d2b4d1e4731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:11.257553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1196/2416] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:11.271332 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae09f-1bff-457d-a12d-05766f1a09f1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.271613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae09f-1bff-457d-a12d-05766f1a09f1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.272829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae09f-1bff-457d-a12d-05766f1a09f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.293983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ee0ae09f-1bff-457d-a12d-05766f1a09f1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:11.295805 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ee0ae09f-1bff-457d-a12d-05766f1a09f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:11.305178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1221/2417] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:11.309274 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13805b3-b634-4ba8-8540-1d2b4d1e4731 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:11.319919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13805b3-b634-4ba8-8540-1d2b4d1e4731 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:11.324984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:11.325621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.325905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.326219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.326970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:49:11.327294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:11.328915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:11.330727 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:11.343578 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1197/2418] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:49:11.348026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae09f-1bff-457d-a12d-05766f1a09f1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:11.357450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae09f-1bff-457d-a12d-05766f1a09f1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:11.362916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7710-3951-492d-9022-67c384700dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:11.363572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7710-3951-492d-9022-67c384700dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.363850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7710-3951-492d-9022-67c384700dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.364123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec7710-3951-492d-9022-67c384700dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.364821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec7710-3951-492d-9022-67c384700dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:11.366790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec7710-3951-492d-9022-67c384700dc3 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:11.376693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:11.396073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1222/2419] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:11 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:11.400650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:11.411349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06af8e-df38-4bf7-8dfb-ba2bc97a45b2 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:11.473072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34def3-fdd6-4b92-8dc4-bc3ebcad650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:11.473775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34def3-fdd6-4b92-8dc4-bc3ebcad650a admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.474109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34def3-fdd6-4b92-8dc4-bc3ebcad650a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.474373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34def3-fdd6-4b92-8dc4-bc3ebcad650a admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.475067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34def3-fdd6-4b92-8dc4-bc3ebcad650a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:11.477002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34def3-fdd6-4b92-8dc4-bc3ebcad650a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:11.498359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1198/2420] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:11 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:11.503087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7710-3951-492d-9022-67c384700dc3 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:11.513975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec7710-3951-492d-9022-67c384700dc3 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:11.520199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b487-e887-4b33-8ca7-1c25f64ea67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:11.520896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b487-e887-4b33-8ca7-1c25f64ea67b admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.521177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b487-e887-4b33-8ca7-1c25f64ea67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.521451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329b487-e887-4b33-8ca7-1c25f64ea67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.522225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329b487-e887-4b33-8ca7-1c25f64ea67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:11.523835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329b487-e887-4b33-8ca7-1c25f64ea67b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:11.535470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1223/2421] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:11.539848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34def3-fdd6-4b92-8dc4-bc3ebcad650a admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:11.554313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34def3-fdd6-4b92-8dc4-bc3ebcad650a admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:11.559537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486734f-d2f8-4ce3-9ab1-0a02f3383bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:11.560201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486734f-d2f8-4ce3-9ab1-0a02f3383bdb admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.560488 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486734f-d2f8-4ce3-9ab1-0a02f3383bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.560771 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486734f-d2f8-4ce3-9ab1-0a02f3383bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.561513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486734f-d2f8-4ce3-9ab1-0a02f3383bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:11.563175 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486734f-d2f8-4ce3-9ab1-0a02f3383bdb admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:11.575705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1199/2422] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:11.580160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b487-e887-4b33-8ca7-1c25f64ea67b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:11.595385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329b487-e887-4b33-8ca7-1c25f64ea67b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:11.600530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:11.601399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.601683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.601986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] PATH_INFO: `/v3/projects/0ecab392f7e14b129483a01677f1c868/users/4f91a4d5690b4dbc87faa7adf75dfb99/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.618174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ecab392f7e14b129483a01677f1c868, user_id=4f91a4d5690b4dbc87faa7adf75dfb99, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:11.620830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:11.636656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1224/2423] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:11 2022] PUT /identity/v3/projects/0ecab392f7e14b129483a01677f1c868/users/4f91a4d5690b4dbc87faa7adf75dfb99/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:11.641889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0d4b-e648-44e9-b6ee-13991359573c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.642239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0d4b-e648-44e9-b6ee-13991359573c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.642557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0d4b-e648-44e9-b6ee-13991359573c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.660183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-e39a0d4b-e648-44e9-b6ee-13991359573c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:11.661447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e39a0d4b-e648-44e9-b6ee-13991359573c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:11.725654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1200/2424] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:11.736064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:11.739159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:11.800605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332653c-8706-4e6b-8765-aa0d99eb91af admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:11.805255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886eb2b-f83b-4172-81f0-18aad879edf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:11.805907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886eb2b-f83b-4172-81f0-18aad879edf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:11.806228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886eb2b-f83b-4172-81f0-18aad879edf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:11.806502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886eb2b-f83b-4172-81f0-18aad879edf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:11.816125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886eb2b-f83b-4172-81f0-18aad879edf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:11.817572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886eb2b-f83b-4172-81f0-18aad879edf7 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:11.827888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1225/2425] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:12.475279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a27d-6e87-421a-80b0-5afb2e4853b5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:12.475544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a27d-6e87-421a-80b0-5afb2e4853b5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:12.475859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5a27d-6e87-421a-80b0-5afb2e4853b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:12.504041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-7dd5a27d-6e87-421a-80b0-5afb2e4853b5 None None] MFA Rules not processed for user `4f91a4d5690b4dbc87faa7adf75dfb99`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:12.505386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7dd5a27d-6e87-421a-80b0-5afb2e4853b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:12.575837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1201/2426] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:12.580574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886eb2b-f83b-4172-81f0-18aad879edf7 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:12.591110 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886eb2b-f83b-4172-81f0-18aad879edf7 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:12.596260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3652c36-5f11-4036-9cd5-65348bc13762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:12.596956 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3652c36-5f11-4036-9cd5-65348bc13762 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:12.597240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3652c36-5f11-4036-9cd5-65348bc13762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:12.597517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3652c36-5f11-4036-9cd5-65348bc13762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:12.598283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3652c36-5f11-4036-9cd5-65348bc13762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:12.600249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3652c36-5f11-4036-9cd5-65348bc13762 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:12.631627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1226/2427] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:12 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:12.632886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5a27d-6e87-421a-80b0-5afb2e4853b5 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:12.638415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:12.644823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5a27d-6e87-421a-80b0-5afb2e4853b5 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:12.702214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa085ff-e5d9-4912-96d6-736fc4257958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:12.702893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa085ff-e5d9-4912-96d6-736fc4257958 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:12.703176 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa085ff-e5d9-4912-96d6-736fc4257958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:12.703452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa085ff-e5d9-4912-96d6-736fc4257958 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:12.704152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa085ff-e5d9-4912-96d6-736fc4257958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:12.706123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa085ff-e5d9-4912-96d6-736fc4257958 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:12.729288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1202/2428] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:12 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:12.733858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3652c36-5f11-4036-9cd5-65348bc13762 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:12.745577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3652c36-5f11-4036-9cd5-65348bc13762 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:12.750185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1be03-8ce5-435b-ac27-aa62d6b46737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:12.750853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1be03-8ce5-435b-ac27-aa62d6b46737 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:12.751145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1be03-8ce5-435b-ac27-aa62d6b46737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:12.751425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1be03-8ce5-435b-ac27-aa62d6b46737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:12.752165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1be03-8ce5-435b-ac27-aa62d6b46737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:12.753773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1be03-8ce5-435b-ac27-aa62d6b46737 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:12.764650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1227/2429] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:12.769074 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa085ff-e5d9-4912-96d6-736fc4257958 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:12.779579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa085ff-e5d9-4912-96d6-736fc4257958 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:12.785504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f5216-346c-4be5-8702-4d1c3e792b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:12.786452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f5216-346c-4be5-8702-4d1c3e792b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:12.786727 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f5216-346c-4be5-8702-4d1c3e792b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:12.787002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f5216-346c-4be5-8702-4d1c3e792b3f admin admin] PATH_INFO: `/v3/projects/57de4f63ec9e4bb8a1de5be88026c908/users/a17aa1c9d1de4f248c6a0a30cdb68e07/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:12.804255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f5216-346c-4be5-8702-4d1c3e792b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=57de4f63ec9e4bb8a1de5be88026c908, user_id=a17aa1c9d1de4f248c6a0a30cdb68e07, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:12.806995 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f5216-346c-4be5-8702-4d1c3e792b3f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:12.822367 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1203/2430] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:12 2022] PUT /identity/v3/projects/57de4f63ec9e4bb8a1de5be88026c908/users/a17aa1c9d1de4f248c6a0a30cdb68e07/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:49:12.826498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1be03-8ce5-435b-ac27-aa62d6b46737 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:12.836581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1be03-8ce5-435b-ac27-aa62d6b46737 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:12.893750 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0196-6be4-43d2-8304-e7643183b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:12.894636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0196-6be4-43d2-8304-e7643183b491 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:12.894918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0196-6be4-43d2-8304-e7643183b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:12.895231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0196-6be4-43d2-8304-e7643183b491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:12.895985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0196-6be4-43d2-8304-e7643183b491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:12.897568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0196-6be4-43d2-8304-e7643183b491 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:12.909108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1228/2431] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:12.913700 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f5216-346c-4be5-8702-4d1c3e792b3f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:12.924903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f5216-346c-4be5-8702-4d1c3e792b3f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:12.931214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60938731-821c-45c7-8d7e-d7c227fdd541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:12.932101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60938731-821c-45c7-8d7e-d7c227fdd541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:12.932380 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60938731-821c-45c7-8d7e-d7c227fdd541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:12.932654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60938731-821c-45c7-8d7e-d7c227fdd541 admin admin] PATH_INFO: `/v3/projects/57de4f63ec9e4bb8a1de5be88026c908/users/a17aa1c9d1de4f248c6a0a30cdb68e07/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:12.936275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60938731-821c-45c7-8d7e-d7c227fdd541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57de4f63ec9e4bb8a1de5be88026c908, user_id=a17aa1c9d1de4f248c6a0a30cdb68e07, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:12.939019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60938731-821c-45c7-8d7e-d7c227fdd541 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:12.952732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1204/2432] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:12 2022] PUT /identity/v3/projects/57de4f63ec9e4bb8a1de5be88026c908/users/a17aa1c9d1de4f248c6a0a30cdb68e07/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:49:13.607277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be5fcb-aac5-4ca0-85d0-0d1df7120971 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:13.607559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be5fcb-aac5-4ca0-85d0-0d1df7120971 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:13.607943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be5fcb-aac5-4ca0-85d0-0d1df7120971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:13.635556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-55be5fcb-aac5-4ca0-85d0-0d1df7120971 None None] MFA Rules not processed for user `a17aa1c9d1de4f248c6a0a30cdb68e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:13.636788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-55be5fcb-aac5-4ca0-85d0-0d1df7120971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:13.647295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:13.709325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1229/2433] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:14.747990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60938731-821c-45c7-8d7e-d7c227fdd541 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:14.813552 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60938731-821c-45c7-8d7e-d7c227fdd541 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:14.818724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:14.819947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:14.820226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:14.820501 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] PATH_INFO: `/v3/users/4f91a4d5690b4dbc87faa7adf75dfb99` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:14.821756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f91a4d5690b4dbc87faa7adf75dfb99)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:14.823744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:14.873600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f91a4d5690b4dbc87faa7adf75dfb99'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:14.874198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f91a4d5690b4dbc87faa7adf75dfb99'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:14.882618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f91a4d5690b4dbc87faa7adf75dfb99'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:14.884598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:14.890543 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f91a4d5690b4dbc87faa7adf75dfb99'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:14.902669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f91a4d5690b4dbc87faa7adf75dfb99'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:14.908577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1205/2434] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:14 2022] DELETE /identity/v3/users/4f91a4d5690b4dbc87faa7adf75dfb99 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:15.087316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be5fcb-aac5-4ca0-85d0-0d1df7120971 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:15.098274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be5fcb-aac5-4ca0-85d0-0d1df7120971 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:15.160259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:15.161155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:15.161412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:15.161695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] PATH_INFO: `/v3/projects/0ecab392f7e14b129483a01677f1c868` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:15.162959 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ecab392f7e14b129483a01677f1c868)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:15.164874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:15.214901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ecab392f7e14b129483a01677f1c868', 'request_id': 'req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.224167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ecab392f7e14b129483a01677f1c868', 'request_id': 'req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.230163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ecab392f7e14b129483a01677f1c868', 'request_id': 'req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.241240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] The token cache is being invalidate because project 0ecab392f7e14b129483a01677f1c868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:15.241530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.242266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.243916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1230/2435] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:15 2022] DELETE /identity/v3/projects/0ecab392f7e14b129483a01677f1c868 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:15.248013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:15.249551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:15.265187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838279fe-d27c-4717-afb1-080d9ef62869 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:15.332636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:15.333524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:15.333798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:15.334109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] PATH_INFO: `/v3/users/a17aa1c9d1de4f248c6a0a30cdb68e07` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:15.335350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17aa1c9d1de4f248c6a0a30cdb68e07)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:15.337291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:15.387922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17aa1c9d1de4f248c6a0a30cdb68e07'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.388589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17aa1c9d1de4f248c6a0a30cdb68e07'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.397568 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17aa1c9d1de4f248c6a0a30cdb68e07'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.405063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17aa1c9d1de4f248c6a0a30cdb68e07'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.418683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa687eb4-0d0c-4c42-9925-92179db3d186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17aa1c9d1de4f248c6a0a30cdb68e07'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.424855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1206/2436] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:15 2022] DELETE /identity/v3/users/a17aa1c9d1de4f248c6a0a30cdb68e07 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:15.603786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:15.605307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:15.618804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a62cf-71bc-4e0a-b2f6-3dc18aa01216 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:15.654676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:15.679492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:15.680296 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:15.680582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:15.680860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] PATH_INFO: `/v3/projects/57de4f63ec9e4bb8a1de5be88026c908` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:15.682140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] RBAC: Authorizing `identity:delete_project(project_id=57de4f63ec9e4bb8a1de5be88026c908)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:15.684175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:15.744291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57de4f63ec9e4bb8a1de5be88026c908', 'request_id': 'req-56f3353f-8261-49c4-a182-7a244cfc326d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.755807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57de4f63ec9e4bb8a1de5be88026c908', 'request_id': 'req-56f3353f-8261-49c4-a182-7a244cfc326d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.761647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57de4f63ec9e4bb8a1de5be88026c908', 'request_id': 'req-56f3353f-8261-49c4-a182-7a244cfc326d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.773765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] The token cache is being invalidate because project 57de4f63ec9e4bb8a1de5be88026c908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:15.774107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.774830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-56f3353f-8261-49c4-a182-7a244cfc326d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:15.776367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1231/2437] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:15 2022] DELETE /identity/v3/projects/57de4f63ec9e4bb8a1de5be88026c908 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:15.781749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53c17-faf7-4ce3-99f5-7b9060c4d79b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:15.782298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53c17-faf7-4ce3-99f5-7b9060c4d79b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:15.782298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d53c17-faf7-4ce3-99f5-7b9060c4d79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:15.799875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-12d53c17-faf7-4ce3-99f5-7b9060c4d79b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:15.801049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-12d53c17-faf7-4ce3-99f5-7b9060c4d79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:15.850307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:15.863736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1207/2438] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:15.871893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d9578-7d60-4e77-9c01-d86a380ac76e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:15.872182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d9578-7d60-4e77-9c01-d86a380ac76e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:15.872464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d9578-7d60-4e77-9c01-d86a380ac76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:15.890692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-135d9578-7d60-4e77-9c01-d86a380ac76e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:15.891906 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-135d9578-7d60-4e77-9c01-d86a380ac76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:15.900651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1232/2439] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:15.905250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53c17-faf7-4ce3-99f5-7b9060c4d79b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:15.916429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d53c17-faf7-4ce3-99f5-7b9060c4d79b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:15.923138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:15.923779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:15.924066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:15.924343 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:15.925068 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:49:15.925381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:15.927027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:15.939312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1208/2440] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:49:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:49:15.943731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d9578-7d60-4e77-9c01-d86a380ac76e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:15.954199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d9578-7d60-4e77-9c01-d86a380ac76e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:15.960086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09c14d-a0ca-4a15-b1f6-4523bb6b74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:15.960773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09c14d-a0ca-4a15-b1f6-4523bb6b74c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:15.961059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09c14d-a0ca-4a15-b1f6-4523bb6b74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:15.961338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09c14d-a0ca-4a15-b1f6-4523bb6b74c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:15.962095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09c14d-a0ca-4a15-b1f6-4523bb6b74c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:15.964037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09c14d-a0ca-4a15-b1f6-4523bb6b74c1 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:15.994689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1233/2441] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:15 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:15.997054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.007892 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce19bb-f4eb-4a83-91e1-9149b61243b0 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.067926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf03e-1aa5-497e-83f8-9f8f91de596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.068664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf03e-1aa5-497e-83f8-9f8f91de596b admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.068960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf03e-1aa5-497e-83f8-9f8f91de596b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.069559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf03e-1aa5-497e-83f8-9f8f91de596b admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.070283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cf03e-1aa5-497e-83f8-9f8f91de596b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.072200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cf03e-1aa5-497e-83f8-9f8f91de596b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.096830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1209/2442] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:15 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:16.102274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09c14d-a0ca-4a15-b1f6-4523bb6b74c1 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.113268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09c14d-a0ca-4a15-b1f6-4523bb6b74c1 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.118949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c8ba5-56dd-4eb9-b322-c9bd47f32de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.119613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8ba5-56dd-4eb9-b322-c9bd47f32de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.120188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8ba5-56dd-4eb9-b322-c9bd47f32de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.120471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8ba5-56dd-4eb9-b322-c9bd47f32de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.121240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c8ba5-56dd-4eb9-b322-c9bd47f32de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.122893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c8ba5-56dd-4eb9-b322-c9bd47f32de6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.134306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1234/2443] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:16.138403 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf03e-1aa5-497e-83f8-9f8f91de596b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.149425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf03e-1aa5-497e-83f8-9f8f91de596b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.154641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06501c93-08f0-4fbb-be9c-1a48ffa2babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.155369 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501c93-08f0-4fbb-be9c-1a48ffa2babc admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.155657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501c93-08f0-4fbb-be9c-1a48ffa2babc admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.155938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06501c93-08f0-4fbb-be9c-1a48ffa2babc admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.156685 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06501c93-08f0-4fbb-be9c-1a48ffa2babc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.158381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06501c93-08f0-4fbb-be9c-1a48ffa2babc admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.170226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1210/2444] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:16.176108 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c8ba5-56dd-4eb9-b322-c9bd47f32de6 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.187267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c8ba5-56dd-4eb9-b322-c9bd47f32de6 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.192590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26031d-97ee-4fa1-bc93-bf4359a557d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.193431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26031d-97ee-4fa1-bc93-bf4359a557d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.193858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26031d-97ee-4fa1-bc93-bf4359a557d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.194573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26031d-97ee-4fa1-bc93-bf4359a557d6 admin admin] PATH_INFO: `/v3/projects/52bedfd346334ca9b0d90d44d5fd7690/users/972b1d6683e146ab81498aef3edf3753/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.210653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26031d-97ee-4fa1-bc93-bf4359a557d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52bedfd346334ca9b0d90d44d5fd7690, user_id=972b1d6683e146ab81498aef3edf3753, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.213310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26031d-97ee-4fa1-bc93-bf4359a557d6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.229002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1235/2445] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:16 2022] PUT /identity/v3/projects/52bedfd346334ca9b0d90d44d5fd7690/users/972b1d6683e146ab81498aef3edf3753/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:16.239234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48799d4a-2e37-4cbf-87f1-171c9804163f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.239525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48799d4a-2e37-4cbf-87f1-171c9804163f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.239805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48799d4a-2e37-4cbf-87f1-171c9804163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.267290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-48799d4a-2e37-4cbf-87f1-171c9804163f None None] MFA Rules not processed for user `972b1d6683e146ab81498aef3edf3753`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:16.268725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-48799d4a-2e37-4cbf-87f1-171c9804163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:16.341385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1211/2446] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:16.346068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26031d-97ee-4fa1-bc93-bf4359a557d6 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.416980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26031d-97ee-4fa1-bc93-bf4359a557d6 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.426012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272b642-f642-4804-b086-59ad2585bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.427051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b642-f642-4804-b086-59ad2585bc48 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.427419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b642-f642-4804-b086-59ad2585bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.427792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272b642-f642-4804-b086-59ad2585bc48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.428984 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272b642-f642-4804-b086-59ad2585bc48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.430640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272b642-f642-4804-b086-59ad2585bc48 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.439412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:16.462721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1236/2447] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:16 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:49:16.466205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48799d4a-2e37-4cbf-87f1-171c9804163f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.477357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48799d4a-2e37-4cbf-87f1-171c9804163f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.523414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:16.537907 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4817e-b5f7-425a-9f3d-ab4ba46ae254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.538617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4817e-b5f7-425a-9f3d-ab4ba46ae254 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.538904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4817e-b5f7-425a-9f3d-ab4ba46ae254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.539201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4817e-b5f7-425a-9f3d-ab4ba46ae254 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.539895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4817e-b5f7-425a-9f3d-ab4ba46ae254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.541879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4817e-b5f7-425a-9f3d-ab4ba46ae254 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.565918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1212/2448] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:16 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:16.570569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272b642-f642-4804-b086-59ad2585bc48 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.581170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272b642-f642-4804-b086-59ad2585bc48 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.586081 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb985c-c6ac-4374-b708-a95448ca18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.586745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb985c-c6ac-4374-b708-a95448ca18b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.587027 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb985c-c6ac-4374-b708-a95448ca18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.587301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb985c-c6ac-4374-b708-a95448ca18b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.588041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb985c-c6ac-4374-b708-a95448ca18b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.589638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb985c-c6ac-4374-b708-a95448ca18b6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.600357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1237/2449] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:16.604405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4817e-b5f7-425a-9f3d-ab4ba46ae254 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.614800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4817e-b5f7-425a-9f3d-ab4ba46ae254 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.620325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a59e-f984-4d03-8db1-68733eda396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.621204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a59e-f984-4d03-8db1-68733eda396d admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.621486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a59e-f984-4d03-8db1-68733eda396d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.621749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317a59e-f984-4d03-8db1-68733eda396d admin admin] PATH_INFO: `/v3/projects/747fc71902fe44dc9ee8546c62e7a270/users/1551b37586124dcc98a64e196cfddbbf/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.638187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a59e-f984-4d03-8db1-68733eda396d admin admin] RBAC: Authorizing `identity:create_grant(project_id=747fc71902fe44dc9ee8546c62e7a270, user_id=1551b37586124dcc98a64e196cfddbbf, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.640831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317a59e-f984-4d03-8db1-68733eda396d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.656376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1213/2450] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:16 2022] PUT /identity/v3/projects/747fc71902fe44dc9ee8546c62e7a270/users/1551b37586124dcc98a64e196cfddbbf/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:16.660473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb985c-c6ac-4374-b708-a95448ca18b6 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.671129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb985c-c6ac-4374-b708-a95448ca18b6 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.731931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9487c4-f765-4a9e-9bbb-bbbca61d9b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.732515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9487c4-f765-4a9e-9bbb-bbbca61d9b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.732832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9487c4-f765-4a9e-9bbb-bbbca61d9b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.733114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9487c4-f765-4a9e-9bbb-bbbca61d9b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.733837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9487c4-f765-4a9e-9bbb-bbbca61d9b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.735477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9487c4-f765-4a9e-9bbb-bbbca61d9b15 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.745491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1238/2451] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:16.754109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a59e-f984-4d03-8db1-68733eda396d admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.764888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317a59e-f984-4d03-8db1-68733eda396d admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.770051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.770884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.771165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.771433 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] PATH_INFO: `/v3/projects/747fc71902fe44dc9ee8546c62e7a270/users/1551b37586124dcc98a64e196cfddbbf/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.773707 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=747fc71902fe44dc9ee8546c62e7a270, user_id=1551b37586124dcc98a64e196cfddbbf, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.776408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:16.786966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1214/2452] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:16 2022] PUT /identity/v3/projects/747fc71902fe44dc9ee8546c62e7a270/users/1551b37586124dcc98a64e196cfddbbf/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:16.798578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930e3c-6bed-443c-ac88-eed6a5e847e4 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.798892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930e3c-6bed-443c-ac88-eed6a5e847e4 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.799167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32930e3c-6bed-443c-ac88-eed6a5e847e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.826920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-32930e3c-6bed-443c-ac88-eed6a5e847e4 None None] MFA Rules not processed for user `1551b37586124dcc98a64e196cfddbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:16.828135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-32930e3c-6bed-443c-ac88-eed6a5e847e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:16.904808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1239/2453] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:16.916065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:16.918086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:16.978719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fa243-1004-45d2-9350-3cccb4c2c77f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:16.982991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd0bf-df5a-404a-9283-8fbbcb8fa8ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:16.983580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd0bf-df5a-404a-9283-8fbbcb8fa8ea service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:16.983865 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd0bf-df5a-404a-9283-8fbbcb8fa8ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:16.984142 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd0bf-df5a-404a-9283-8fbbcb8fa8ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:16.993647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfd0bf-df5a-404a-9283-8fbbcb8fa8ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:16.995127 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfd0bf-df5a-404a-9283-8fbbcb8fa8ea service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:17.004621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1215/2454] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:17.103624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32930e3c-6bed-443c-ac88-eed6a5e847e4 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:17.113581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32930e3c-6bed-443c-ac88-eed6a5e847e4 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:17.117584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b1014-c95c-4e31-986c-b81606a0aaee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:17.118263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1014-c95c-4e31-986c-b81606a0aaee service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:17.118547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1014-c95c-4e31-986c-b81606a0aaee service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:17.118822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1014-c95c-4e31-986c-b81606a0aaee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:17.175740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b1014-c95c-4e31-986c-b81606a0aaee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:17.178131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b1014-c95c-4e31-986c-b81606a0aaee service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:17.181921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:17.188856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1240/2455] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:20.852398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd0bf-df5a-404a-9283-8fbbcb8fa8ea service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:20.926230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd0bf-df5a-404a-9283-8fbbcb8fa8ea service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:20.932129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:20.933012 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:20.933293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:20.933566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] PATH_INFO: `/v3/users/972b1d6683e146ab81498aef3edf3753` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:20.934789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=972b1d6683e146ab81498aef3edf3753)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:20.936748 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:20.995679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:20.997338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972b1d6683e146ab81498aef3edf3753'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:20.998074 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972b1d6683e146ab81498aef3edf3753'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.007524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972b1d6683e146ab81498aef3edf3753'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.014844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972b1d6683e146ab81498aef3edf3753'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.026456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972b1d6683e146ab81498aef3edf3753'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.032243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1216/2456] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:20 2022] DELETE /identity/v3/users/972b1d6683e146ab81498aef3edf3753 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:21.036963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d064-c39c-40b9-ab0e-0930481933be None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:21.037437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d064-c39c-40b9-ab0e-0930481933be None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:21.037533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f2d064-c39c-40b9-ab0e-0930481933be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:21.056434 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f5f2d064-c39c-40b9-ab0e-0930481933be None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:21.057630 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f5f2d064-c39c-40b9-ab0e-0930481933be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:21.120446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1241/2457] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:21.130712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:21.132589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:21.193245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d68e37-55e7-47cb-85f8-0c31ec233b2f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:21.197539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9392413-343b-4f3c-a3d4-fcc5e6b6baf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:21.198232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392413-343b-4f3c-a3d4-fcc5e6b6baf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:21.198511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392413-343b-4f3c-a3d4-fcc5e6b6baf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:21.198787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392413-343b-4f3c-a3d4-fcc5e6b6baf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:21.208283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9392413-343b-4f3c-a3d4-fcc5e6b6baf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:21.209767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9392413-343b-4f3c-a3d4-fcc5e6b6baf9 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:21.220129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1217/2458] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:21.485846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d064-c39c-40b9-ab0e-0930481933be None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:21.487387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f5f2d064-c39c-40b9-ab0e-0930481933be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:21.502755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f2d064-c39c-40b9-ab0e-0930481933be None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:21.509252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:21.511386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:21.511671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:21.511940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] PATH_INFO: `/v3/projects/52bedfd346334ca9b0d90d44d5fd7690` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:21.513190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52bedfd346334ca9b0d90d44d5fd7690)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:21.515469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:21.564909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52bedfd346334ca9b0d90d44d5fd7690', 'request_id': 'req-a7e3245d-16b6-4caa-adff-4489eac86b80'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.574502 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52bedfd346334ca9b0d90d44d5fd7690', 'request_id': 'req-a7e3245d-16b6-4caa-adff-4489eac86b80'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.580474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52bedfd346334ca9b0d90d44d5fd7690', 'request_id': 'req-a7e3245d-16b6-4caa-adff-4489eac86b80'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.591418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] The token cache is being invalidate because project 52bedfd346334ca9b0d90d44d5fd7690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:21.591700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.592333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.593890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1242/2459] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:21 2022] DELETE /identity/v3/projects/52bedfd346334ca9b0d90d44d5fd7690 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:21.603359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9392413-343b-4f3c-a3d4-fcc5e6b6baf9 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:21.613449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9392413-343b-4f3c-a3d4-fcc5e6b6baf9 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:21.671608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:21.672827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:21.673167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:21.673455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] PATH_INFO: `/v3/users/1551b37586124dcc98a64e196cfddbbf` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:21.674961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1551b37586124dcc98a64e196cfddbbf)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:21.677939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:21.727393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1551b37586124dcc98a64e196cfddbbf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.728067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1551b37586124dcc98a64e196cfddbbf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.736619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1551b37586124dcc98a64e196cfddbbf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.743666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1551b37586124dcc98a64e196cfddbbf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.748247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:21.758672 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3f123ef5-0403-4a06-bfea-76ac8d4b785e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1551b37586124dcc98a64e196cfddbbf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:21.766961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1218/2460] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:21 2022] DELETE /identity/v3/users/1551b37586124dcc98a64e196cfddbbf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:22.051455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.053172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:22.067394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3245d-16b6-4caa-adff-4489eac86b80 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.133766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.134646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.134927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.135203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] PATH_INFO: `/v3/projects/747fc71902fe44dc9ee8546c62e7a270` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.136451 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] RBAC: Authorizing `identity:delete_project(project_id=747fc71902fe44dc9ee8546c62e7a270)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.138425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:22.163487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:22.190896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747fc71902fe44dc9ee8546c62e7a270', 'request_id': 'req-9358b7a9-f70c-4360-8c3f-87321ba2cade'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:22.200297 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747fc71902fe44dc9ee8546c62e7a270', 'request_id': 'req-9358b7a9-f70c-4360-8c3f-87321ba2cade'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:22.205855 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747fc71902fe44dc9ee8546c62e7a270', 'request_id': 'req-9358b7a9-f70c-4360-8c3f-87321ba2cade'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:22.219082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] The token cache is being invalidate because project 747fc71902fe44dc9ee8546c62e7a270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:22.219374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:22.220059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-9358b7a9-f70c-4360-8c3f-87321ba2cade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:22.221702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1243/2461] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:22 2022] DELETE /identity/v3/projects/747fc71902fe44dc9ee8546c62e7a270 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:22.226961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf87e9-4605-4c69-b9e8-66018dc25393 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.227564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf87e9-4605-4c69-b9e8-66018dc25393 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.227564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf87e9-4605-4c69-b9e8-66018dc25393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.245686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-20bf87e9-4605-4c69-b9e8-66018dc25393 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:22.246920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-20bf87e9-4605-4c69-b9e8-66018dc25393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:22.306842 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1219/2462] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:22.315878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d8e6-6e24-4f8b-bb07-acd27181f7ca None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.316221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d8e6-6e24-4f8b-bb07-acd27181f7ca None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.316592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02d8e6-6e24-4f8b-bb07-acd27181f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.343652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8c02d8e6-6e24-4f8b-bb07-acd27181f7ca None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:22.344882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8c02d8e6-6e24-4f8b-bb07-acd27181f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:22.353785 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1244/2463] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:22.358181 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf87e9-4605-4c69-b9e8-66018dc25393 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.368036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf87e9-4605-4c69-b9e8-66018dc25393 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.374118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.374770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.375051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.375324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.376057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:49:22.376364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.377997 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:22.390452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1220/2464] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:49:22.395327 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d8e6-6e24-4f8b-bb07-acd27181f7ca None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.405926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02d8e6-6e24-4f8b-bb07-acd27181f7ca None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.411800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1debe-594f-4573-bf81-bd8177ef36cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.412448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1debe-594f-4573-bf81-bd8177ef36cd admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.412727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1debe-594f-4573-bf81-bd8177ef36cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.412998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1debe-594f-4573-bf81-bd8177ef36cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.413870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1debe-594f-4573-bf81-bd8177ef36cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.415815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1debe-594f-4573-bf81-bd8177ef36cd admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:22.450460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1245/2465] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:22 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:22.455045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.466965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93be2d-3e65-4aa5-b5b1-8395fd5e67fa admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.537297 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468128-ffdd-43b0-8f19-669d9edfe62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.538317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468128-ffdd-43b0-8f19-669d9edfe62c admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.538649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468128-ffdd-43b0-8f19-669d9edfe62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.539022 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b468128-ffdd-43b0-8f19-669d9edfe62c admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.540051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b468128-ffdd-43b0-8f19-669d9edfe62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.543242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b468128-ffdd-43b0-8f19-669d9edfe62c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:22.571512 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1221/2466] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:22 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:22.577076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1debe-594f-4573-bf81-bd8177ef36cd admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.587940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1debe-594f-4573-bf81-bd8177ef36cd admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.593658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20432-46c7-4386-a129-17ec15924906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.594372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20432-46c7-4386-a129-17ec15924906 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.594677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20432-46c7-4386-a129-17ec15924906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.594949 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20432-46c7-4386-a129-17ec15924906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.595679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d20432-46c7-4386-a129-17ec15924906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.598954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d20432-46c7-4386-a129-17ec15924906 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:22.609925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1246/2467] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:49:22.614397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468128-ffdd-43b0-8f19-669d9edfe62c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.625326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b468128-ffdd-43b0-8f19-669d9edfe62c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.631241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8776cf-f83e-45ad-b6c0-c15a7cf01d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.631933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8776cf-f83e-45ad-b6c0-c15a7cf01d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.632207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8776cf-f83e-45ad-b6c0-c15a7cf01d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.632511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8776cf-f83e-45ad-b6c0-c15a7cf01d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.633228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8776cf-f83e-45ad-b6c0-c15a7cf01d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.634878 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8776cf-f83e-45ad-b6c0-c15a7cf01d2c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:22.645897 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1222/2468] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:22.650369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20432-46c7-4386-a129-17ec15924906 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.661421 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20432-46c7-4386-a129-17ec15924906 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.666966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc2b6-b244-4b9c-96f8-54b51a2b2bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.667857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc2b6-b244-4b9c-96f8-54b51a2b2bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.668142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc2b6-b244-4b9c-96f8-54b51a2b2bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.668419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bc2b6-b244-4b9c-96f8-54b51a2b2bee admin admin] PATH_INFO: `/v3/projects/a376aaf9e0fa42668ea876f4e158803c/users/94446b38a2d8480181617fa9610057a7/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.684024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bc2b6-b244-4b9c-96f8-54b51a2b2bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a376aaf9e0fa42668ea876f4e158803c, user_id=94446b38a2d8480181617fa9610057a7, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.687029 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bc2b6-b244-4b9c-96f8-54b51a2b2bee admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:22.703524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1247/2469] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:22 2022] PUT /identity/v3/projects/a376aaf9e0fa42668ea876f4e158803c/users/94446b38a2d8480181617fa9610057a7/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:22.714306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb5c7-26e0-4270-b6a6-e19d34d6a55a None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.714694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb5c7-26e0-4270-b6a6-e19d34d6a55a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.714981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6eb5c7-26e0-4270-b6a6-e19d34d6a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.747029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-3e6eb5c7-26e0-4270-b6a6-e19d34d6a55a None None] MFA Rules not processed for user `94446b38a2d8480181617fa9610057a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:22.748259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3e6eb5c7-26e0-4270-b6a6-e19d34d6a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:22.788165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:22.813308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1223/2470] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:22.817929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc2b6-b244-4b9c-96f8-54b51a2b2bee admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.882614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bc2b6-b244-4b9c-96f8-54b51a2b2bee admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.887827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46309439-c3aa-4284-8286-c37eca83315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.888491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309439-c3aa-4284-8286-c37eca83315c admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.888776 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309439-c3aa-4284-8286-c37eca83315c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.889052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309439-c3aa-4284-8286-c37eca83315c admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.889746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46309439-c3aa-4284-8286-c37eca83315c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.891706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46309439-c3aa-4284-8286-c37eca83315c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:22.921533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1248/2471] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:22 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:22.925409 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb5c7-26e0-4270-b6a6-e19d34d6a55a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:22.937006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6eb5c7-26e0-4270-b6a6-e19d34d6a55a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:22.995811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4813597-0b83-40f4-87f2-f7660e51bed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:22.996394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4813597-0b83-40f4-87f2-f7660e51bed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:22.996670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4813597-0b83-40f4-87f2-f7660e51bed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:22.996938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4813597-0b83-40f4-87f2-f7660e51bed8 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:22.997636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4813597-0b83-40f4-87f2-f7660e51bed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:22.999567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4813597-0b83-40f4-87f2-f7660e51bed8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:23.023494 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1224/2472] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:22 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:49:23.027618 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46309439-c3aa-4284-8286-c37eca83315c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:23.038503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46309439-c3aa-4284-8286-c37eca83315c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:23.043635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267efd-73a9-4d28-9a3c-4ab4d34df416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:23.044298 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267efd-73a9-4d28-9a3c-4ab4d34df416 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:23.044578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267efd-73a9-4d28-9a3c-4ab4d34df416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:23.044852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43267efd-73a9-4d28-9a3c-4ab4d34df416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:23.045579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267efd-73a9-4d28-9a3c-4ab4d34df416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:23.047315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43267efd-73a9-4d28-9a3c-4ab4d34df416 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:23.058366 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1249/2473] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:23.062674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4813597-0b83-40f4-87f2-f7660e51bed8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:23.073666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4813597-0b83-40f4-87f2-f7660e51bed8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:23.079101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4ae33-3ab9-468f-a5db-9fc710602609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:23.079989 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ae33-3ab9-468f-a5db-9fc710602609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:23.080269 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ae33-3ab9-468f-a5db-9fc710602609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:23.080546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ae33-3ab9-468f-a5db-9fc710602609 admin admin] PATH_INFO: `/v3/projects/b5af00d5ca084ad99b26b0862bfa97d8/users/61dfd424fff44ffabb0972330d45cc78/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:23.096963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4ae33-3ab9-468f-a5db-9fc710602609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5af00d5ca084ad99b26b0862bfa97d8, user_id=61dfd424fff44ffabb0972330d45cc78, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:23.099683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4ae33-3ab9-468f-a5db-9fc710602609 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:23.115029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1225/2474] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:23 2022] PUT /identity/v3/projects/b5af00d5ca084ad99b26b0862bfa97d8/users/61dfd424fff44ffabb0972330d45cc78/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:23.119099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267efd-73a9-4d28-9a3c-4ab4d34df416 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:23.129102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43267efd-73a9-4d28-9a3c-4ab4d34df416 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:23.147387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:23.185337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d2941-a001-4c1b-9911-bb2eb2fa6833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:23.186101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d2941-a001-4c1b-9911-bb2eb2fa6833 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:23.186433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d2941-a001-4c1b-9911-bb2eb2fa6833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:23.186730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d2941-a001-4c1b-9911-bb2eb2fa6833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:23.187474 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d2941-a001-4c1b-9911-bb2eb2fa6833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:23.189071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d2941-a001-4c1b-9911-bb2eb2fa6833 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:23.199986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1250/2475] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:23.204419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4ae33-3ab9-468f-a5db-9fc710602609 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:23.215659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4ae33-3ab9-468f-a5db-9fc710602609 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:23.221244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:23.222262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:23.222544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:23.222894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] PATH_INFO: `/v3/projects/b5af00d5ca084ad99b26b0862bfa97d8/users/61dfd424fff44ffabb0972330d45cc78/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:23.225086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5af00d5ca084ad99b26b0862bfa97d8, user_id=61dfd424fff44ffabb0972330d45cc78, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:23.227964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:23.238870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1226/2476] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:23 2022] PUT /identity/v3/projects/b5af00d5ca084ad99b26b0862bfa97d8/users/61dfd424fff44ffabb0972330d45cc78/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:23.250428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8bd5-79f3-4107-82f6-24d7f08a1a4b None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:23.250654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8bd5-79f3-4107-82f6-24d7f08a1a4b None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:23.250957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d8bd5-79f3-4107-82f6-24d7f08a1a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:23.279682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ec6d8bd5-79f3-4107-82f6-24d7f08a1a4b None None] MFA Rules not processed for user `61dfd424fff44ffabb0972330d45cc78`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:23.280885 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ec6d8bd5-79f3-4107-82f6-24d7f08a1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:23.352771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1251/2477] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:23.363919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:23.365807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:23.430356 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d9ef9-a954-40bf-8491-9862e718a301 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:23.434547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8b9b2-f873-4ca8-9c84-6612564f88f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:23.435139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b9b2-f873-4ca8-9c84-6612564f88f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:23.435424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b9b2-f873-4ca8-9c84-6612564f88f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:23.435701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b9b2-f873-4ca8-9c84-6612564f88f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:23.480274 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:23.493830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b9b2-f873-4ca8-9c84-6612564f88f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:23.495325 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b9b2-f873-4ca8-9c84-6612564f88f8 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:23.504209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1227/2478] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:26.110640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8bd5-79f3-4107-82f6-24d7f08a1a4b None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:26.176431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d8bd5-79f3-4107-82f6-24d7f08a1a4b None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:26.181728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:26.182626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:26.182902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:26.183172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] PATH_INFO: `/v3/users/94446b38a2d8480181617fa9610057a7` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:26.184401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94446b38a2d8480181617fa9610057a7)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:26.186359 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:26.236774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:26.238638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94446b38a2d8480181617fa9610057a7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.250404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94446b38a2d8480181617fa9610057a7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.251265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94446b38a2d8480181617fa9610057a7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.258792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94446b38a2d8480181617fa9610057a7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.271778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94446b38a2d8480181617fa9610057a7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.277971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1252/2479] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:26 2022] DELETE /identity/v3/users/94446b38a2d8480181617fa9610057a7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:26.282669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989af23-102b-4529-a633-280ec5ca334a None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:26.283134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989af23-102b-4529-a633-280ec5ca334a None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:26.283259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989af23-102b-4529-a633-280ec5ca334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:26.300393 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b989af23-102b-4529-a633-280ec5ca334a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:26.301579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b989af23-102b-4529-a633-280ec5ca334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:26.359864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1228/2480] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:49:26.369845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:26.371546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:26.435239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb39d95-ecbd-4f7a-b670-83627aca943c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:26.439249 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5209-a9b6-413c-8435-488a0497d6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:26.439895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5209-a9b6-413c-8435-488a0497d6fc service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:26.440188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5209-a9b6-413c-8435-488a0497d6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:26.440504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5209-a9b6-413c-8435-488a0497d6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:26.450198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5209-a9b6-413c-8435-488a0497d6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:26.451640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5209-a9b6-413c-8435-488a0497d6fc service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:26.461106 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1253/2481] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:26.768836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989af23-102b-4529-a633-280ec5ca334a None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:26.770469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b989af23-102b-4529-a633-280ec5ca334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:26.782674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989af23-102b-4529-a633-280ec5ca334a None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:26.787427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:26.788427 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:26.788712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:26.788986 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] PATH_INFO: `/v3/projects/a376aaf9e0fa42668ea876f4e158803c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:26.790330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a376aaf9e0fa42668ea876f4e158803c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:26.792273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:26.841402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a376aaf9e0fa42668ea876f4e158803c', 'request_id': 'req-41f967df-3cde-4a07-8781-76b24b76e104'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.849527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a376aaf9e0fa42668ea876f4e158803c', 'request_id': 'req-41f967df-3cde-4a07-8781-76b24b76e104'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.855229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a376aaf9e0fa42668ea876f4e158803c', 'request_id': 'req-41f967df-3cde-4a07-8781-76b24b76e104'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.866071 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] The token cache is being invalidate because project a376aaf9e0fa42668ea876f4e158803c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:26.866300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.866965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:26.868508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1229/2482] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:26 2022] DELETE /identity/v3/projects/a376aaf9e0fa42668ea876f4e158803c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:26.872522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5209-a9b6-413c-8435-488a0497d6fc service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:26.882173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5209-a9b6-413c-8435-488a0497d6fc service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:26.941306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:26.942318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:26.942612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:26.942888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] PATH_INFO: `/v3/users/61dfd424fff44ffabb0972330d45cc78` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:26.944495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dfd424fff44ffabb0972330d45cc78)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:26.946530 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:26.999336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dfd424fff44ffabb0972330d45cc78'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.008415 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dfd424fff44ffabb0972330d45cc78'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.009049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dfd424fff44ffabb0972330d45cc78'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.016018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dfd424fff44ffabb0972330d45cc78'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.020320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:27.029799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08e22ed1-e84f-4588-ba68-e543bbae162f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dfd424fff44ffabb0972330d45cc78'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.036147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1254/2483] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:26 2022] DELETE /identity/v3/users/61dfd424fff44ffabb0972330d45cc78 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:27.332145 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:27.333644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:27.347110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f967df-3cde-4a07-8781-76b24b76e104 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:27.407870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:27.408663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.408977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.409232 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] PATH_INFO: `/v3/projects/b5af00d5ca084ad99b26b0862bfa97d8` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.411123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5af00d5ca084ad99b26b0862bfa97d8)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:27.413981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:27.426262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:27.468435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5af00d5ca084ad99b26b0862bfa97d8', 'request_id': 'req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.478038 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5af00d5ca084ad99b26b0862bfa97d8', 'request_id': 'req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.483775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5af00d5ca084ad99b26b0862bfa97d8', 'request_id': 'req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.494885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] The token cache is being invalidate because project b5af00d5ca084ad99b26b0862bfa97d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:27.495172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.495874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa3cc2ac-6146-4a77-8a40-919a941e1fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:27.497546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1230/2484] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:27 2022] DELETE /identity/v3/projects/b5af00d5ca084ad99b26b0862bfa97d8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:27.502599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abec31-f44a-4756-8542-dc3fa6521385 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.503095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abec31-f44a-4756-8542-dc3fa6521385 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.503204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abec31-f44a-4756-8542-dc3fa6521385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.521365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-43abec31-f44a-4756-8542-dc3fa6521385 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:27.522656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-43abec31-f44a-4756-8542-dc3fa6521385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:27.583504 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1255/2485] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:27.591832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d633bf-9372-461d-871d-b23db5837db5 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.592123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d633bf-9372-461d-871d-b23db5837db5 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.592410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d633bf-9372-461d-871d-b23db5837db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.611824 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-31d633bf-9372-461d-871d-b23db5837db5 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:27.613037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-31d633bf-9372-461d-871d-b23db5837db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:27.625158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1231/2486] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:27.629624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abec31-f44a-4756-8542-dc3fa6521385 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:27.640787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abec31-f44a-4756-8542-dc3fa6521385 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:27.646806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:27.647486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.647766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.648107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.648842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:49:27.649147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:27.650780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:27.663136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1256/2487] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:49:27.667589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d633bf-9372-461d-871d-b23db5837db5 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:27.677151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d633bf-9372-461d-871d-b23db5837db5 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:27.683376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7bb6-b55f-45c4-bc1c-4005dce33965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:27.684058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7bb6-b55f-45c4-bc1c-4005dce33965 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.684339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7bb6-b55f-45c4-bc1c-4005dce33965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.684613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7bb6-b55f-45c4-bc1c-4005dce33965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.685376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7bb6-b55f-45c4-bc1c-4005dce33965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:27.687413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7bb6-b55f-45c4-bc1c-4005dce33965 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:27.718106 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1232/2488] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:27 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:27.722273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:27.732252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6853f-8a2a-4fed-9436-7d68fb831725 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:27.802286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8636d-637b-4925-88f4-795844364d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:27.802990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8636d-637b-4925-88f4-795844364d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.803270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8636d-637b-4925-88f4-795844364d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.803549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8636d-637b-4925-88f4-795844364d83 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.804321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8636d-637b-4925-88f4-795844364d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:27.806242 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8636d-637b-4925-88f4-795844364d83 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:27.829422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1257/2489] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:27 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:49:27.834078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7bb6-b55f-45c4-bc1c-4005dce33965 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:27.844623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7bb6-b55f-45c4-bc1c-4005dce33965 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:27.849755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902b0f2-4a59-4857-a2c0-edbf9378722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:27.850438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902b0f2-4a59-4857-a2c0-edbf9378722e admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.850721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902b0f2-4a59-4857-a2c0-edbf9378722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.850990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902b0f2-4a59-4857-a2c0-edbf9378722e admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.851716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902b0f2-4a59-4857-a2c0-edbf9378722e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:27.853355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902b0f2-4a59-4857-a2c0-edbf9378722e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:27.863927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1233/2490] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:27.867934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8636d-637b-4925-88f4-795844364d83 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:27.878178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8636d-637b-4925-88f4-795844364d83 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:27.883542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd1c06-eb30-4a68-92de-456e9d982553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:27.884379 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1c06-eb30-4a68-92de-456e9d982553 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.884736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1c06-eb30-4a68-92de-456e9d982553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.885020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1c06-eb30-4a68-92de-456e9d982553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.885760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd1c06-eb30-4a68-92de-456e9d982553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:27.887503 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd1c06-eb30-4a68-92de-456e9d982553 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:27.897599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1258/2491] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:27.903345 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902b0f2-4a59-4857-a2c0-edbf9378722e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:27.916132 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902b0f2-4a59-4857-a2c0-edbf9378722e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:27.921551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a422f0-f6e7-42a7-931e-cff3cdf0b0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:27.922554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a422f0-f6e7-42a7-931e-cff3cdf0b0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.922834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a422f0-f6e7-42a7-931e-cff3cdf0b0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.923105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a422f0-f6e7-42a7-931e-cff3cdf0b0b8 admin admin] PATH_INFO: `/v3/projects/558898d214bc4c8a9a6ae06f5d98641e/users/ae237b6d3b874e10aa2722b10dfed8be/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:27.943786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a422f0-f6e7-42a7-931e-cff3cdf0b0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558898d214bc4c8a9a6ae06f5d98641e, user_id=ae237b6d3b874e10aa2722b10dfed8be, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:27.947100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a422f0-f6e7-42a7-931e-cff3cdf0b0b8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:27.962914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1234/2492] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:27 2022] PUT /identity/v3/projects/558898d214bc4c8a9a6ae06f5d98641e/users/ae237b6d3b874e10aa2722b10dfed8be/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:27.973316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f75dca-91cc-4d76-8231-122a99ef4a8f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:27.973613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f75dca-91cc-4d76-8231-122a99ef4a8f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:27.973902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f75dca-91cc-4d76-8231-122a99ef4a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.000523 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-18f75dca-91cc-4d76-8231-122a99ef4a8f None None] MFA Rules not processed for user `ae237b6d3b874e10aa2722b10dfed8be`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:28.001769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-18f75dca-91cc-4d76-8231-122a99ef4a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:28.042243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:28.068369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1259/2493] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:28.073340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a422f0-f6e7-42a7-931e-cff3cdf0b0b8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.138861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a422f0-f6e7-42a7-931e-cff3cdf0b0b8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.144025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74c36-755f-4f64-a90e-2ca4abef7da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.144690 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74c36-755f-4f64-a90e-2ca4abef7da6 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.144979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74c36-755f-4f64-a90e-2ca4abef7da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.145254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74c36-755f-4f64-a90e-2ca4abef7da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.145974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74c36-755f-4f64-a90e-2ca4abef7da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.147909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74c36-755f-4f64-a90e-2ca4abef7da6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.177242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1235/2494] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:28 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:28.181538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f75dca-91cc-4d76-8231-122a99ef4a8f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.192671 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f75dca-91cc-4d76-8231-122a99ef4a8f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.263198 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603fce-7dae-44cd-9b5f-0604b870a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.263877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603fce-7dae-44cd-9b5f-0604b870a137 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.264162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603fce-7dae-44cd-9b5f-0604b870a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.264441 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4603fce-7dae-44cd-9b5f-0604b870a137 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.265412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4603fce-7dae-44cd-9b5f-0604b870a137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.267205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4603fce-7dae-44cd-9b5f-0604b870a137 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.290835 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1260/2495] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:28 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:28.296062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74c36-755f-4f64-a90e-2ca4abef7da6 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.309036 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74c36-755f-4f64-a90e-2ca4abef7da6 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.313969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25cdc4-998c-42a8-953c-d67b5a2504ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.314669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25cdc4-998c-42a8-953c-d67b5a2504ce admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.314967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25cdc4-998c-42a8-953c-d67b5a2504ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.315243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25cdc4-998c-42a8-953c-d67b5a2504ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.315956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25cdc4-998c-42a8-953c-d67b5a2504ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.317612 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25cdc4-998c-42a8-953c-d67b5a2504ce admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.328955 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1236/2496] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:28.333195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603fce-7dae-44cd-9b5f-0604b870a137 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.343639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4603fce-7dae-44cd-9b5f-0604b870a137 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.348532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602031b5-0a1a-429d-984a-fa269dbdbc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.349188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602031b5-0a1a-429d-984a-fa269dbdbc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.349472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602031b5-0a1a-429d-984a-fa269dbdbc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.349749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602031b5-0a1a-429d-984a-fa269dbdbc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.350512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602031b5-0a1a-429d-984a-fa269dbdbc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.352103 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602031b5-0a1a-429d-984a-fa269dbdbc84 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.362613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1261/2497] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:28.367270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25cdc4-998c-42a8-953c-d67b5a2504ce admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.377713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25cdc4-998c-42a8-953c-d67b5a2504ce admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.383306 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bb577-3eaa-46fa-a0ab-e5c28d3dfb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.384247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bb577-3eaa-46fa-a0ab-e5c28d3dfb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.384531 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bb577-3eaa-46fa-a0ab-e5c28d3dfb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.384804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9bb577-3eaa-46fa-a0ab-e5c28d3dfb5c admin admin] PATH_INFO: `/v3/projects/a0ee3d01e19c491a890acd280b3bdf57/users/3e919544ea2c4081898f9b24d94bacc5/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.393787 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:28.403720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bb577-3eaa-46fa-a0ab-e5c28d3dfb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ee3d01e19c491a890acd280b3bdf57, user_id=3e919544ea2c4081898f9b24d94bacc5, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.407473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9bb577-3eaa-46fa-a0ab-e5c28d3dfb5c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.428479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1237/2498] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:28 2022] PUT /identity/v3/projects/a0ee3d01e19c491a890acd280b3bdf57/users/3e919544ea2c4081898f9b24d94bacc5/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:28.444706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec1996-747f-432f-9312-c16fbe57f15c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.444985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec1996-747f-432f-9312-c16fbe57f15c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.445265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec1996-747f-432f-9312-c16fbe57f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.473444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-12ec1996-747f-432f-9312-c16fbe57f15c None None] MFA Rules not processed for user `3e919544ea2c4081898f9b24d94bacc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:28.474676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-12ec1996-747f-432f-9312-c16fbe57f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:28.540329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1262/2499] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:28.544832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bb577-3eaa-46fa-a0ab-e5c28d3dfb5c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.616327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9bb577-3eaa-46fa-a0ab-e5c28d3dfb5c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.622006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb1218-980f-4440-a985-09a8f5573198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.622699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb1218-980f-4440-a985-09a8f5573198 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.622980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb1218-980f-4440-a985-09a8f5573198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.623257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb1218-980f-4440-a985-09a8f5573198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.623987 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb1218-980f-4440-a985-09a8f5573198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.625976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb1218-980f-4440-a985-09a8f5573198 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.654291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1238/2500] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:28 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:28.658393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec1996-747f-432f-9312-c16fbe57f15c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.669983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec1996-747f-432f-9312-c16fbe57f15c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.718860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:28.732432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1eddc-f3ba-4fe2-868b-5385f9c62380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.733124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1eddc-f3ba-4fe2-868b-5385f9c62380 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.733413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1eddc-f3ba-4fe2-868b-5385f9c62380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.733692 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1eddc-f3ba-4fe2-868b-5385f9c62380 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.734453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1eddc-f3ba-4fe2-868b-5385f9c62380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.736426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1eddc-f3ba-4fe2-868b-5385f9c62380 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.762345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1263/2501] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:28 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:28.767242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb1218-980f-4440-a985-09a8f5573198 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.782311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb1218-980f-4440-a985-09a8f5573198 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.789890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed942e4-c33a-48ea-acf9-6101972873eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.790572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed942e4-c33a-48ea-acf9-6101972873eb admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.790875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed942e4-c33a-48ea-acf9-6101972873eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.791144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed942e4-c33a-48ea-acf9-6101972873eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.791862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed942e4-c33a-48ea-acf9-6101972873eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.793458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed942e4-c33a-48ea-acf9-6101972873eb admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.804906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1239/2502] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:28.809182 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1eddc-f3ba-4fe2-868b-5385f9c62380 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.820873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1eddc-f3ba-4fe2-868b-5385f9c62380 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.827440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9f1d5-f942-44d8-b3df-2f451bcb72f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.828860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9f1d5-f942-44d8-b3df-2f451bcb72f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.829323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9f1d5-f942-44d8-b3df-2f451bcb72f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.829697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9f1d5-f942-44d8-b3df-2f451bcb72f8 admin admin] PATH_INFO: `/v3/projects/28fb5cd423214bcdb60fef02ddc9fd03/users/651c96c23a224bd5afd36dd1dd089db6/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.853234 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9f1d5-f942-44d8-b3df-2f451bcb72f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28fb5cd423214bcdb60fef02ddc9fd03, user_id=651c96c23a224bd5afd36dd1dd089db6, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.856057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed9f1d5-f942-44d8-b3df-2f451bcb72f8 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.872223 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1264/2503] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:28 2022] PUT /identity/v3/projects/28fb5cd423214bcdb60fef02ddc9fd03/users/651c96c23a224bd5afd36dd1dd089db6/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:28.876328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed942e4-c33a-48ea-acf9-6101972873eb admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.886760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed942e4-c33a-48ea-acf9-6101972873eb admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.944469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf2cc1-fb39-4b8f-97d1-a41ee0fbde6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.945172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2cc1-fb39-4b8f-97d1-a41ee0fbde6c admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.945455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2cc1-fb39-4b8f-97d1-a41ee0fbde6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.945731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf2cc1-fb39-4b8f-97d1-a41ee0fbde6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.946495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf2cc1-fb39-4b8f-97d1-a41ee0fbde6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.948123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf2cc1-fb39-4b8f-97d1-a41ee0fbde6c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.958096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1240/2504] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:49:28.962562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9f1d5-f942-44d8-b3df-2f451bcb72f8 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:28.974475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9f1d5-f942-44d8-b3df-2f451bcb72f8 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:28.979816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:28.980769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:28.981048 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:28.981329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] PATH_INFO: `/v3/projects/28fb5cd423214bcdb60fef02ddc9fd03/users/651c96c23a224bd5afd36dd1dd089db6/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:28.983470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28fb5cd423214bcdb60fef02ddc9fd03, user_id=651c96c23a224bd5afd36dd1dd089db6, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:28.986212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:28.999576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1265/2505] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:28 2022] PUT /identity/v3/projects/28fb5cd423214bcdb60fef02ddc9fd03/users/651c96c23a224bd5afd36dd1dd089db6/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:29.012329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1521e94-9e62-414b-ad81-75b4ebacede3 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:29.012616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1521e94-9e62-414b-ad81-75b4ebacede3 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:29.012898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1521e94-9e62-414b-ad81-75b4ebacede3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:29.040803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a1521e94-9e62-414b-ad81-75b4ebacede3 None None] MFA Rules not processed for user `651c96c23a224bd5afd36dd1dd089db6`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:29.042040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a1521e94-9e62-414b-ad81-75b4ebacede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:29.089595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:29.130851 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1241/2506] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:29.144564 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:29.146897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:29.206263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3088fbc-d8f1-4577-96bc-24b2124699f5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:29.210524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:29.211274 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:29.211419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:29.211733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:29.277414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:29.278820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:29.287969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1266/2507] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:30.637257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1521e94-9e62-414b-ad81-75b4ebacede3 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:30.638626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a1521e94-9e62-414b-ad81-75b4ebacede3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:30.708631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1521e94-9e62-414b-ad81-75b4ebacede3 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:30.712469 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:30.712932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:30.713217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:30.713496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:30.715272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:30.726184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:30.727687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:30.735905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1242/2508] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:30.793862 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:30.795879 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:30.809078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450b98-2401-4694-8538-025b0867d8cb service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:30.813008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f50a1-a8e6-4090-92bb-79b633c4668d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:30.813680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f50a1-a8e6-4090-92bb-79b633c4668d service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:30.814266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f50a1-a8e6-4090-92bb-79b633c4668d service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:30.814547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f50a1-a8e6-4090-92bb-79b633c4668d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:30.872335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:30.876487 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f50a1-a8e6-4090-92bb-79b633c4668d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:30.878790 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f50a1-a8e6-4090-92bb-79b633c4668d service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:30.889245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1267/2509] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:31.429679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:31.439173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99027dd5-2abb-481d-83cc-f6e3ca2225fa service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:31.443091 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22001294-2cde-413a-95d1-2569347263f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:31.443730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001294-2cde-413a-95d1-2569347263f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:31.444326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001294-2cde-413a-95d1-2569347263f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:31.444593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22001294-2cde-413a-95d1-2569347263f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:31.455041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001294-2cde-413a-95d1-2569347263f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:31.456714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22001294-2cde-413a-95d1-2569347263f6 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:31.467354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1243/2510] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:35.376260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f50a1-a8e6-4090-92bb-79b633c4668d service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:35.439466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f50a1-a8e6-4090-92bb-79b633c4668d service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:35.444864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:35.445742 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:35.446074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:35.446354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] PATH_INFO: `/v3/users/ae237b6d3b874e10aa2722b10dfed8be` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:35.447586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae237b6d3b874e10aa2722b10dfed8be)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:35.449572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:35.500033 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae237b6d3b874e10aa2722b10dfed8be'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:35.508845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae237b6d3b874e10aa2722b10dfed8be'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:35.509608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae237b6d3b874e10aa2722b10dfed8be'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:35.516620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae237b6d3b874e10aa2722b10dfed8be'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:35.528660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae237b6d3b874e10aa2722b10dfed8be'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:35.535261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1268/2511] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:35 2022] DELETE /identity/v3/users/ae237b6d3b874e10aa2722b10dfed8be => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:35.540141 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9374da6-7751-4919-b6bd-b7e34f3704d8 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:35.540660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9374da6-7751-4919-b6bd-b7e34f3704d8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:35.540660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9374da6-7751-4919-b6bd-b7e34f3704d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:35.558829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d9374da6-7751-4919-b6bd-b7e34f3704d8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:35.560045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d9374da6-7751-4919-b6bd-b7e34f3704d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:35.621979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1244/2512] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:35.631946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:35.633659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:35.691271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1a667-02de-4463-81fe-7577da869b86 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:35.695582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09ffd7-3188-41c6-b25d-c6702c373b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:35.696205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ffd7-3188-41c6-b25d-c6702c373b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:35.696491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ffd7-3188-41c6-b25d-c6702c373b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:35.696765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09ffd7-3188-41c6-b25d-c6702c373b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:35.706045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09ffd7-3188-41c6-b25d-c6702c373b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:35.707494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09ffd7-3188-41c6-b25d-c6702c373b10 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:35.717175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1269/2513] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:36.002086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9374da6-7751-4919-b6bd-b7e34f3704d8 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:36.003667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d9374da6-7751-4919-b6bd-b7e34f3704d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:36.018906 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9374da6-7751-4919-b6bd-b7e34f3704d8 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:36.023718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:36.024607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:36.024889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:36.025157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] PATH_INFO: `/v3/projects/558898d214bc4c8a9a6ae06f5d98641e` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:36.027223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=558898d214bc4c8a9a6ae06f5d98641e)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:36.029527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:36.078268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558898d214bc4c8a9a6ae06f5d98641e', 'request_id': 'req-a0b6880b-ecf4-4d51-b95c-26f17b49d385'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.087790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558898d214bc4c8a9a6ae06f5d98641e', 'request_id': 'req-a0b6880b-ecf4-4d51-b95c-26f17b49d385'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.093736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558898d214bc4c8a9a6ae06f5d98641e', 'request_id': 'req-a0b6880b-ecf4-4d51-b95c-26f17b49d385'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.095970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:36.106879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] The token cache is being invalidate because project 558898d214bc4c8a9a6ae06f5d98641e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:36.107348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.108017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.109637 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1245/2514] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:36 2022] DELETE /identity/v3/projects/558898d214bc4c8a9a6ae06f5d98641e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:36.114210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09ffd7-3188-41c6-b25d-c6702c373b10 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:36.124511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09ffd7-3188-41c6-b25d-c6702c373b10 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:36.136717 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:36.182212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:36.183089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:36.183376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:36.183658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] PATH_INFO: `/v3/users/3e919544ea2c4081898f9b24d94bacc5` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:36.184865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e919544ea2c4081898f9b24d94bacc5)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:36.186834 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:36.237555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e919544ea2c4081898f9b24d94bacc5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.246989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e919544ea2c4081898f9b24d94bacc5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.247650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e919544ea2c4081898f9b24d94bacc5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.255201 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e919544ea2c4081898f9b24d94bacc5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.266830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e919544ea2c4081898f9b24d94bacc5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.273384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1270/2515] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:36 2022] DELETE /identity/v3/users/3e919544ea2c4081898f9b24d94bacc5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:49:36.564554 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:36.566229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:36.582575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6880b-ecf4-4d51-b95c-26f17b49d385 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:36.642505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:36.643652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:36.644118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:36.644600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] PATH_INFO: `/v3/projects/a0ee3d01e19c491a890acd280b3bdf57` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:36.646740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ee3d01e19c491a890acd280b3bdf57)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:36.650480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:36.709379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ee3d01e19c491a890acd280b3bdf57', 'request_id': 'req-b5b1cf53-5e3b-48c5-93d1-94019228acb9'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.718713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ee3d01e19c491a890acd280b3bdf57', 'request_id': 'req-b5b1cf53-5e3b-48c5-93d1-94019228acb9'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.724607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ee3d01e19c491a890acd280b3bdf57', 'request_id': 'req-b5b1cf53-5e3b-48c5-93d1-94019228acb9'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.735663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] The token cache is being invalidate because project a0ee3d01e19c491a890acd280b3bdf57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:36.735949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.736691 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.738424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1246/2516] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:36 2022] DELETE /identity/v3/projects/a0ee3d01e19c491a890acd280b3bdf57 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:36.742632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:36.744289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:36.757853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7e78-f519-4663-ae7d-1cd5e485e28e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:36.816127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:36.817016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:36.817308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:36.817607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] PATH_INFO: `/v3/users/651c96c23a224bd5afd36dd1dd089db6` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:36.819147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=651c96c23a224bd5afd36dd1dd089db6)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:36.821082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:36.868295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:36.877395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651c96c23a224bd5afd36dd1dd089db6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.888051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651c96c23a224bd5afd36dd1dd089db6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.888657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651c96c23a224bd5afd36dd1dd089db6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.895893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651c96c23a224bd5afd36dd1dd089db6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.907795 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ccc1be9-2a45-4f97-89fb-f27ad5ec4403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651c96c23a224bd5afd36dd1dd089db6'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:36.913721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1271/2517] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:49:36 2022] DELETE /identity/v3/users/651c96c23a224bd5afd36dd1dd089db6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:37.200889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:37.202429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:37.217563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1cf53-5e3b-48c5-93d1-94019228acb9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:37.282218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:37.283101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.283379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.283650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] PATH_INFO: `/v3/projects/28fb5cd423214bcdb60fef02ddc9fd03` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.284949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28fb5cd423214bcdb60fef02ddc9fd03)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:37.286945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:37.321371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:37.336937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28fb5cd423214bcdb60fef02ddc9fd03', 'request_id': 'req-512c2f69-4431-4f1b-af78-5de502e92282'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:37.345252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28fb5cd423214bcdb60fef02ddc9fd03', 'request_id': 'req-512c2f69-4431-4f1b-af78-5de502e92282'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:37.350952 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28fb5cd423214bcdb60fef02ddc9fd03', 'request_id': 'req-512c2f69-4431-4f1b-af78-5de502e92282'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:37.361832 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] The token cache is being invalidate because project 28fb5cd423214bcdb60fef02ddc9fd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:49:37.362146 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:37.362783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-512c2f69-4431-4f1b-af78-5de502e92282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:49:37.364311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1247/2518] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:49:37 2022] DELETE /identity/v3/projects/28fb5cd423214bcdb60fef02ddc9fd03 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:37.369326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2659-a3ef-44ad-8468-b43850cc497e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.369689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2659-a3ef-44ad-8468-b43850cc497e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.370001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c2659-a3ef-44ad-8468-b43850cc497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.388298 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e43c2659-a3ef-44ad-8468-b43850cc497e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:37.389477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e43c2659-a3ef-44ad-8468-b43850cc497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:37.450260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1272/2519] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:37.459812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f118a-326c-4d0d-96df-ad59d6f21cad None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.460154 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f118a-326c-4d0d-96df-ad59d6f21cad None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.460530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f118a-326c-4d0d-96df-ad59d6f21cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.480219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-914f118a-326c-4d0d-96df-ad59d6f21cad None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:37.481404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-914f118a-326c-4d0d-96df-ad59d6f21cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:37.489591 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1248/2520] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:37.493747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2659-a3ef-44ad-8468-b43850cc497e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:37.504157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c2659-a3ef-44ad-8468-b43850cc497e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:37.511347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:37.512001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.512288 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.512544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.513299 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:49:37.513604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:37.515260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:37.527881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1273/2521] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:49:37.532100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f118a-326c-4d0d-96df-ad59d6f21cad None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:37.543614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f118a-326c-4d0d-96df-ad59d6f21cad None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:37.549970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691096a1-be14-4749-bd0e-6da8920ce12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:37.550656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691096a1-be14-4749-bd0e-6da8920ce12c admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.550937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691096a1-be14-4749-bd0e-6da8920ce12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.551206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691096a1-be14-4749-bd0e-6da8920ce12c admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.551902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691096a1-be14-4749-bd0e-6da8920ce12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:37.553831 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691096a1-be14-4749-bd0e-6da8920ce12c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:37.584454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1249/2522] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:49:37 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:37.589044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:37.599656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be69f5-d55b-4cc2-83d8-1de9568b9279 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:37.660551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ccaa0-5a95-4905-8580-3c17c7256c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:37.661226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ccaa0-5a95-4905-8580-3c17c7256c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.661531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ccaa0-5a95-4905-8580-3c17c7256c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.661830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ccaa0-5a95-4905-8580-3c17c7256c6f admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.662563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ccaa0-5a95-4905-8580-3c17c7256c6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:37.664506 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ccaa0-5a95-4905-8580-3c17c7256c6f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:37.688888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1274/2523] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:49:37 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:49:37.694163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691096a1-be14-4749-bd0e-6da8920ce12c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:37.706524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691096a1-be14-4749-bd0e-6da8920ce12c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:37.711863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba82d1f-e71b-42da-83c8-1e42f5d0dde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:37.712598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba82d1f-e71b-42da-83c8-1e42f5d0dde5 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.712875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba82d1f-e71b-42da-83c8-1e42f5d0dde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.713157 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba82d1f-e71b-42da-83c8-1e42f5d0dde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.713868 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba82d1f-e71b-42da-83c8-1e42f5d0dde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:37.715572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba82d1f-e71b-42da-83c8-1e42f5d0dde5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:37.726387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1250/2524] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:49:37.730472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ccaa0-5a95-4905-8580-3c17c7256c6f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:37.741405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ccaa0-5a95-4905-8580-3c17c7256c6f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:37.747137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d31b7-6e7e-407c-a378-d4621c014343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:37.747783 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d31b7-6e7e-407c-a378-d4621c014343 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.748091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d31b7-6e7e-407c-a378-d4621c014343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.748372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d31b7-6e7e-407c-a378-d4621c014343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.749140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d31b7-6e7e-407c-a378-d4621c014343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:37.750781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d31b7-6e7e-407c-a378-d4621c014343 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:37.761275 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1275/2525] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:49:37.765447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba82d1f-e71b-42da-83c8-1e42f5d0dde5 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:37.775776 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba82d1f-e71b-42da-83c8-1e42f5d0dde5 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:37.781509 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:37.782414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.782676 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.782969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] PATH_INFO: `/v3/projects/a26eae74001140bc85f0e80644ecfba9/users/60d4227c0bc444339d59f5b7a024454c/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.798774 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26eae74001140bc85f0e80644ecfba9, user_id=60d4227c0bc444339d59f5b7a024454c, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:37.801457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:37.817500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1251/2526] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:49:37 2022] PUT /identity/v3/projects/a26eae74001140bc85f0e80644ecfba9/users/60d4227c0bc444339d59f5b7a024454c/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:49:37.828293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68236-f068-42ba-b525-1a929d794023 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:37.828580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68236-f068-42ba-b525-1a929d794023 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:37.828873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd68236-f068-42ba-b525-1a929d794023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:37.855664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-4cd68236-f068-42ba-b525-1a929d794023 None None] MFA Rules not processed for user `60d4227c0bc444339d59f5b7a024454c`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:37.856896 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4cd68236-f068-42ba-b525-1a929d794023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:37.865497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:37.924808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1276/2527] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:37.939320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:37.942222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:38.003939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9133795-30f8-4d34-970f-7b15de348cd7 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:38.007944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:38.008587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:38.008883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:38.009160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:38.017985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:38.019434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:38.028478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1252/2528] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:39.412045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f81c4-e9c6-4afe-8bed-bd6961e97d43 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:39.412585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f81c4-e9c6-4afe-8bed-bd6961e97d43 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:39.412585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f81c4-e9c6-4afe-8bed-bd6961e97d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:39.432498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c57f81c4-e9c6-4afe-8bed-bd6961e97d43 None None] MFA Rules not processed for user `60d4227c0bc444339d59f5b7a024454c`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:39.433714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c57f81c4-e9c6-4afe-8bed-bd6961e97d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:39.441970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1277/2529] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:49:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:39.913560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:39.915308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:39.973874 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:39.990755 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3193d7-f6c2-44ce-9799-2a08ac8bb858 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:39.995647 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:39.996290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:39.996646 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:39.996917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:39.998678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:40.010304 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:40.011888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:40.024024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1253/2530] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:46.026761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f81c4-e9c6-4afe-8bed-bd6961e97d43 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:46.029225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c57f81c4-e9c6-4afe-8bed-bd6961e97d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:46.114131 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f81c4-e9c6-4afe-8bed-bd6961e97d43 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:46.124901 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d16f3f-255c-4d9b-8445-338d0ec2dad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:46.125570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d16f3f-255c-4d9b-8445-338d0ec2dad2 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:46.125837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d16f3f-255c-4d9b-8445-338d0ec2dad2 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:46.126152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d16f3f-255c-4d9b-8445-338d0ec2dad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:46.128295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e6d16f3f-255c-4d9b-8445-338d0ec2dad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:46.209392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d16f3f-255c-4d9b-8445-338d0ec2dad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:46.211109 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d16f3f-255c-4d9b-8445-338d0ec2dad2 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:46.231037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1278/2531] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:50.017633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=7 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:55.837217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:55.839259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:55.876655 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0f91e-5635-470c-b697-dc554c01cfab service placement] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:55.882857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:55.883817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:55.884130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:55.884588 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:55.886478 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:55.910558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:55.910558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:55.928275 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1254/2532] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:49:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:49:56.228147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:49:56.817428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339817-58ea-4f00-a87d-9936e33e1875 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:56.817720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339817-58ea-4f00-a87d-9936e33e1875 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:56.818032 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00339817-58ea-4f00-a87d-9936e33e1875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:56.837633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-00339817-58ea-4f00-a87d-9936e33e1875 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:56.839398 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-00339817-58ea-4f00-a87d-9936e33e1875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:56.908054 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1279/2533] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:49:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:56.981361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:56.982949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:57.098884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603d9f6-d5ab-4d22-a948-d7305e6eafdf service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:57.103887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916fcb-7cca-4661-84c4-07f1869c9920 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:57.104538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916fcb-7cca-4661-84c4-07f1869c9920 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:57.104850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916fcb-7cca-4661-84c4-07f1869c9920 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:57.105126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916fcb-7cca-4661-84c4-07f1869c9920 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:57.113290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29916fcb-7cca-4661-84c4-07f1869c9920 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:57.114880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29916fcb-7cca-4661-84c4-07f1869c9920 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:57.122713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1255/2534] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:49:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 19:49:57.666510 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4960f6-3949-4a2a-8294-cda3c08b4a87 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:57.666947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4960f6-3949-4a2a-8294-cda3c08b4a87 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:57.666947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4960f6-3949-4a2a-8294-cda3c08b4a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:57.687537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2d4960f6-3949-4a2a-8294-cda3c08b4a87 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:57.688745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2d4960f6-3949-4a2a-8294-cda3c08b4a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:57.696720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1280/2535] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jul 1 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:57.708969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916fcb-7cca-4661-84c4-07f1869c9920 service swift] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:57.719838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916fcb-7cca-4661-84c4-07f1869c9920 service swift] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:57.725875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8874a-88c7-42e1-9162-3a9f8b5d5787 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:57.726555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8874a-88c7-42e1-9162-3a9f8b5d5787 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:57.726856 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8874a-88c7-42e1-9162-3a9f8b5d5787 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:57.727137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8874a-88c7-42e1-9162-3a9f8b5d5787 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:57.736242 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8874a-88c7-42e1-9162-3a9f8b5d5787 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:57.737846 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8874a-88c7-42e1-9162-3a9f8b5d5787 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:57.746395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1256/2536] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:49:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:49:57.958870 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a63de-f6cf-4e52-abb5-c3c18be8e7d7 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:57.959156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a63de-f6cf-4e52-abb5-c3c18be8e7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:57.959438 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a63de-f6cf-4e52-abb5-c3c18be8e7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:57.978624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-a74a63de-f6cf-4e52-abb5-c3c18be8e7d7 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:57.979826 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a74a63de-f6cf-4e52-abb5-c3c18be8e7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:57.988708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1281/2537] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:58.000511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8874a-88c7-42e1-9162-3a9f8b5d5787 service swift] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:58.011199 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8874a-88c7-42e1-9162-3a9f8b5d5787 service swift] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:58.016365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b52b-b0fe-4e2a-8ea1-acd1bd6e88dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:58.017058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b52b-b0fe-4e2a-8ea1-acd1bd6e88dd service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:58.017320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b52b-b0fe-4e2a-8ea1-acd1bd6e88dd service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:58.017705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b52b-b0fe-4e2a-8ea1-acd1bd6e88dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:58.026290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2b52b-b0fe-4e2a-8ea1-acd1bd6e88dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:58.027881 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2b52b-b0fe-4e2a-8ea1-acd1bd6e88dd service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:58.036621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1257/2538] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:49:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:49:58.401940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fd78e-cd1d-4ef7-b2f7-5c2b3d0de913 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:58.402257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fd78e-cd1d-4ef7-b2f7-5c2b3d0de913 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:58.402535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fd78e-cd1d-4ef7-b2f7-5c2b3d0de913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:58.421386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-7c8fd78e-cd1d-4ef7-b2f7-5c2b3d0de913 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:49:58.422722 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7c8fd78e-cd1d-4ef7-b2f7-5c2b3d0de913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:49:58.430816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1282/2539] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jul 1 19:49:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:49:58.443555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b52b-b0fe-4e2a-8ea1-acd1bd6e88dd service swift] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:49:58.455273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b52b-b0fe-4e2a-8ea1-acd1bd6e88dd service swift] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:49:58.460747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715dbf4-a014-4482-bd73-f8eed5058808 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:49:58.461437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715dbf4-a014-4482-bd73-f8eed5058808 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:49:58.461723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715dbf4-a014-4482-bd73-f8eed5058808 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:49:58.462032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715dbf4-a014-4482-bd73-f8eed5058808 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:49:58.470583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715dbf4-a014-4482-bd73-f8eed5058808 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:49:58.472186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715dbf4-a014-4482-bd73-f8eed5058808 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:49:58.480569 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1258/2540] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:50:00.663334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fd78e-cd1d-4ef7-b2f7-5c2b3d0de913 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:00.738769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fd78e-cd1d-4ef7-b2f7-5c2b3d0de913 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:00.743500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:00.744394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:00.744681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:00.744961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] PATH_INFO: `/v3/users/60d4227c0bc444339d59f5b7a024454c` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:00.746175 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d4227c0bc444339d59f5b7a024454c)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:00.748124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:00.796948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d4227c0bc444339d59f5b7a024454c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:00.805801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d4227c0bc444339d59f5b7a024454c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:00.806544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d4227c0bc444339d59f5b7a024454c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:00.814388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d4227c0bc444339d59f5b7a024454c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:00.831982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d4227c0bc444339d59f5b7a024454c'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:00.838495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1283/2541] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:00 2022] DELETE /identity/v3/users/60d4227c0bc444339d59f5b7a024454c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:00.842984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29222-2eda-4c98-b352-074e37112e0b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:00.843449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29222-2eda-4c98-b352-074e37112e0b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:00.843566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29222-2eda-4c98-b352-074e37112e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:00.861268 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-fcd29222-2eda-4c98-b352-074e37112e0b None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:00.862539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fcd29222-2eda-4c98-b352-074e37112e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:00.929927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1259/2542] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:00.939813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:00.941354 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:00.948891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:01.002629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470cb537-cb88-4cf4-b1f2-92145e109aa8 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.006965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f265b-3c20-433e-beb4-390487f447e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.007304 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f265b-3c20-433e-beb4-390487f447e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.007590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f265b-3c20-433e-beb4-390487f447e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.007868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f265b-3c20-433e-beb4-390487f447e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.018036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f265b-3c20-433e-beb4-390487f447e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:01.019484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f265b-3c20-433e-beb4-390487f447e9 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:01.029740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1284/2543] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:01.262769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29222-2eda-4c98-b352-074e37112e0b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:01.265397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fcd29222-2eda-4c98-b352-074e37112e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:01.282854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29222-2eda-4c98-b352-074e37112e0b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.291130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.292738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.293208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.293493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] PATH_INFO: `/v3/projects/a26eae74001140bc85f0e80644ecfba9` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.294930 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26eae74001140bc85f0e80644ecfba9)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:01.296895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:01.349615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f265b-3c20-433e-beb4-390487f447e9 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:01.362253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f265b-3c20-433e-beb4-390487f447e9 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.367340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa936c-754c-4c9b-b8c5-d1dba43dfa9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.368016 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa936c-754c-4c9b-b8c5-d1dba43dfa9f service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.368305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa936c-754c-4c9b-b8c5-d1dba43dfa9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.368587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa936c-754c-4c9b-b8c5-d1dba43dfa9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.371192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-dbfa936c-754c-4c9b-b8c5-d1dba43dfa9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:01.376566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:01.390547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa936c-754c-4c9b-b8c5-d1dba43dfa9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:01.393221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa936c-754c-4c9b-b8c5-d1dba43dfa9f service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:01.394902 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26eae74001140bc85f0e80644ecfba9', 'request_id': 'req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:01.406842 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1285/2544] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:50:01.419917 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26eae74001140bc85f0e80644ecfba9', 'request_id': 'req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:01.428406 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26eae74001140bc85f0e80644ecfba9', 'request_id': 'req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:01.457820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] The token cache is being invalidate because project a26eae74001140bc85f0e80644ecfba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:01.458158 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:01.460822 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3076f25f-7dc6-4f8d-824a-a3ce62f75f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:01.466699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1260/2545] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:01 2022] DELETE /identity/v3/projects/a26eae74001140bc85f0e80644ecfba9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:01.471987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65099-8b49-4016-a7fe-896b2d17d48c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.476358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65099-8b49-4016-a7fe-896b2d17d48c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.476797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b65099-8b49-4016-a7fe-896b2d17d48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.513243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c1b65099-8b49-4016-a7fe-896b2d17d48c None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:01.516447 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c1b65099-8b49-4016-a7fe-896b2d17d48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:01.613995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1286/2546] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:01.617811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80545c5-402c-4c24-9943-bd1e301810da None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.618155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80545c5-402c-4c24-9943-bd1e301810da None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.618963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80545c5-402c-4c24-9943-bd1e301810da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.640179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a80545c5-402c-4c24-9943-bd1e301810da None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:01.641401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a80545c5-402c-4c24-9943-bd1e301810da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:01.650761 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1261/2547] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:01.655145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b65099-8b49-4016-a7fe-896b2d17d48c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:01.668431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b65099-8b49-4016-a7fe-896b2d17d48c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.673460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.674154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.674435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.674704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.675430 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:50:01.675916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:01.677519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:01.694574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1287/2548] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:50:01.695736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80545c5-402c-4c24-9943-bd1e301810da None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:01.705880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80545c5-402c-4c24-9943-bd1e301810da None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.710879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e149b0b-2857-4aed-b9ae-32fd9b6aaf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.711553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e149b0b-2857-4aed-b9ae-32fd9b6aaf72 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.711963 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e149b0b-2857-4aed-b9ae-32fd9b6aaf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.712244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e149b0b-2857-4aed-b9ae-32fd9b6aaf72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.712968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e149b0b-2857-4aed-b9ae-32fd9b6aaf72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:01.715081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e149b0b-2857-4aed-b9ae-32fd9b6aaf72 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:01.747324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1262/2549] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:01 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:01.751646 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:01.764214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359a392-0f17-400c-b80c-0f983d594966 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.845740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1dc02-819b-4ac5-99c0-ab3465be48ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.846496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1dc02-819b-4ac5-99c0-ab3465be48ae admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.846772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1dc02-819b-4ac5-99c0-ab3465be48ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.847052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1dc02-819b-4ac5-99c0-ab3465be48ae admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.847763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1dc02-819b-4ac5-99c0-ab3465be48ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:01.849697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1dc02-819b-4ac5-99c0-ab3465be48ae admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:01.873673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1288/2550] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:01 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:50:01.878760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e149b0b-2857-4aed-b9ae-32fd9b6aaf72 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:01.894447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e149b0b-2857-4aed-b9ae-32fd9b6aaf72 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.900624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a1352-247e-411c-9684-97c9e120d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.901388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a1352-247e-411c-9684-97c9e120d82f admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.901744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a1352-247e-411c-9684-97c9e120d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.902125 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a1352-247e-411c-9684-97c9e120d82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.902932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a1352-247e-411c-9684-97c9e120d82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:01.904627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a1352-247e-411c-9684-97c9e120d82f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:01.917371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1263/2551] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:01.921537 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1dc02-819b-4ac5-99c0-ab3465be48ae admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:01.936856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1dc02-819b-4ac5-99c0-ab3465be48ae admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.944001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4286d6c-5e30-4961-bb8c-bb0e5f85e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.944661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286d6c-5e30-4961-bb8c-bb0e5f85e8df admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.944960 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286d6c-5e30-4961-bb8c-bb0e5f85e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.945205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4286d6c-5e30-4961-bb8c-bb0e5f85e8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:01.946030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4286d6c-5e30-4961-bb8c-bb0e5f85e8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:01.949412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4286d6c-5e30-4961-bb8c-bb0e5f85e8df admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:01.955414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:01.968353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1289/2552] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:01.969792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a1352-247e-411c-9684-97c9e120d82f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:01.983984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a1352-247e-411c-9684-97c9e120d82f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:01.989190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:01.990566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:01.991009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:01.991455 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] PATH_INFO: `/v3/projects/d13ae3749c0f4f9e80ae0403b41d6b4c/users/9273538810d24fe19acf7c8e190e6dfe/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:02.013725 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d13ae3749c0f4f9e80ae0403b41d6b4c, user_id=9273538810d24fe19acf7c8e190e6dfe, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:02.016803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:02.049788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1264/2553] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:01 2022] PUT /identity/v3/projects/d13ae3749c0f4f9e80ae0403b41d6b4c/users/9273538810d24fe19acf7c8e190e6dfe/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:02.055212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4df70-c020-4a84-9dd1-cb29a9552929 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:02.055739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4df70-c020-4a84-9dd1-cb29a9552929 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:02.056119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c4df70-c020-4a84-9dd1-cb29a9552929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:02.078689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-a1c4df70-c020-4a84-9dd1-cb29a9552929 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:02.080066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a1c4df70-c020-4a84-9dd1-cb29a9552929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:02.154770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1290/2554] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:02.161412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:02.163604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:02.234385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235cda4-f47a-4686-9c4f-f83e1f2d703c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:02.238291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:02.238956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:02.239239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:02.240333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:02.251086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:02.252537 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:02.262489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1265/2555] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:03.474303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f3b4-a49a-4429-8554-05dc62cd980f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:03.475908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f3b4-a49a-4429-8554-05dc62cd980f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:03.476352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f3b4-a49a-4429-8554-05dc62cd980f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:03.520519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c6f6f3b4-a49a-4429-8554-05dc62cd980f None None] MFA Rules not processed for user `9273538810d24fe19acf7c8e190e6dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:03.521977 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c6f6f3b4-a49a-4429-8554-05dc62cd980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:03.643343 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1291/2556] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:03.657616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:03.659827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:03.811772 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca159faa-a088-4726-9298-c9e73a010f9e service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:03.816581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee666b-37c9-41b3-818d-fc42dee04136 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:03.817737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee666b-37c9-41b3-818d-fc42dee04136 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:03.819051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee666b-37c9-41b3-818d-fc42dee04136 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:03.819528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee666b-37c9-41b3-818d-fc42dee04136 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:03.830221 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee666b-37c9-41b3-818d-fc42dee04136 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:03.831760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee666b-37c9-41b3-818d-fc42dee04136 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:03.843778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1266/2557] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:05.191687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6f3b4-a49a-4429-8554-05dc62cd980f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:05.193645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c6f6f3b4-a49a-4429-8554-05dc62cd980f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:05.208601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6f3b4-a49a-4429-8554-05dc62cd980f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:05.214196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:05.215365 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:05.216115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:05.216769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] PATH_INFO: `/v3/users/b5040520134e464ea1d534767ea8728e` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:05.218388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5040520134e464ea1d534767ea8728e)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:05.220672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:05.259109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c153-d891-4cbe-9ef2-f8fbeb5bcf40 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:05.259635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c153-d891-4cbe-9ef2-f8fbeb5bcf40 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:05.259867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c153-d891-4cbe-9ef2-f8fbeb5bcf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:05.266926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:05.282760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c1a8c153-d891-4cbe-9ef2-f8fbeb5bcf40 None None] MFA Rules not processed for user `9273538810d24fe19acf7c8e190e6dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:05.284240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c1a8c153-d891-4cbe-9ef2-f8fbeb5bcf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:05.301202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1267/2558] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:05.312380 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5040520134e464ea1d534767ea8728e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.322752 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5040520134e464ea1d534767ea8728e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.323691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5040520134e464ea1d534767ea8728e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.334592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5040520134e464ea1d534767ea8728e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.351319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-873a12e5-2814-4169-b2a7-42ac9e3c285a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5040520134e464ea1d534767ea8728e'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.359580 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1292/2559] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:05 2022] DELETE /identity/v3/users/b5040520134e464ea1d534767ea8728e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:05.539654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c153-d891-4cbe-9ef2-f8fbeb5bcf40 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:05.551212 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c153-d891-4cbe-9ef2-f8fbeb5bcf40 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:05.614216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:05.615262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:05.615611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:05.615951 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] PATH_INFO: `/v3/projects/9bc18901e30b4252988c065baa36be3c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:05.617299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc18901e30b4252988c065baa36be3c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:05.619329 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:05.669553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc18901e30b4252988c065baa36be3c', 'request_id': 'req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.678595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc18901e30b4252988c065baa36be3c', 'request_id': 'req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.684845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc18901e30b4252988c065baa36be3c', 'request_id': 'req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.697063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] The token cache is being invalidate because project 9bc18901e30b4252988c065baa36be3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:05.697358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.698061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-79f7fd43-4412-4cc0-acdf-cc55d9f3f9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:05.699638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1268/2560] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:05 2022] DELETE /identity/v3/projects/9bc18901e30b4252988c065baa36be3c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:05.704823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ad167-2c2c-4aaa-abde-9899c297c066 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:05.705115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ad167-2c2c-4aaa-abde-9899c297c066 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:05.705401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ad167-2c2c-4aaa-abde-9899c297c066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:05.711828 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:05.727575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-5f0ad167-2c2c-4aaa-abde-9899c297c066 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:05.728796 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5f0ad167-2c2c-4aaa-abde-9899c297c066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:05.791554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1293/2561] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:05.799238 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d90f1-f8ce-46d8-8d96-fc5f716afe80 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:05.799643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d90f1-f8ce-46d8-8d96-fc5f716afe80 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:05.799926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d90f1-f8ce-46d8-8d96-fc5f716afe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:05.819150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-bd4d90f1-f8ce-46d8-8d96-fc5f716afe80 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:05.820503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bd4d90f1-f8ce-46d8-8d96-fc5f716afe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:05.828946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1269/2562] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:05.833973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ad167-2c2c-4aaa-abde-9899c297c066 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:05.844089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ad167-2c2c-4aaa-abde-9899c297c066 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:05.848606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:05.849266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:05.849547 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:05.849821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:05.850590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:50:05.850895 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:05.853093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:05.865511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1294/2563] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:50:05.869899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d90f1-f8ce-46d8-8d96-fc5f716afe80 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:05.881965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d90f1-f8ce-46d8-8d96-fc5f716afe80 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:05.887629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cfdd0-30fa-45f6-a4a0-243d33e22e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:05.888305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfdd0-30fa-45f6-a4a0-243d33e22e41 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:05.888698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfdd0-30fa-45f6-a4a0-243d33e22e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:05.888907 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cfdd0-30fa-45f6-a4a0-243d33e22e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:05.889693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cfdd0-30fa-45f6-a4a0-243d33e22e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:05.891703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cfdd0-30fa-45f6-a4a0-243d33e22e41 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:05.927515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1270/2564] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:05 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:05.931556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:05.949258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a5516-6514-4920-96e1-47978d186884 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.009640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884ae0-0913-4724-ab04-23a7e1b861c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.010350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884ae0-0913-4724-ab04-23a7e1b861c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.010633 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884ae0-0913-4724-ab04-23a7e1b861c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.010914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58884ae0-0913-4724-ab04-23a7e1b861c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.011620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58884ae0-0913-4724-ab04-23a7e1b861c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.013712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58884ae0-0913-4724-ab04-23a7e1b861c2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.037141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1295/2565] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:05 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:06.041560 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cfdd0-30fa-45f6-a4a0-243d33e22e41 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.052978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cfdd0-30fa-45f6-a4a0-243d33e22e41 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.059721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9675bf-8cfc-4a30-b3c6-ca2d995597c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.060404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9675bf-8cfc-4a30-b3c6-ca2d995597c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.060844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9675bf-8cfc-4a30-b3c6-ca2d995597c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.061125 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9675bf-8cfc-4a30-b3c6-ca2d995597c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.061866 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9675bf-8cfc-4a30-b3c6-ca2d995597c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.063522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9675bf-8cfc-4a30-b3c6-ca2d995597c6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.076615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1271/2566] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:06.080163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884ae0-0913-4724-ab04-23a7e1b861c2 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.094347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58884ae0-0913-4724-ab04-23a7e1b861c2 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.099299 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02762091-760c-40e8-888c-5a05e3f59da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.099978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762091-760c-40e8-888c-5a05e3f59da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.100265 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762091-760c-40e8-888c-5a05e3f59da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.100546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02762091-760c-40e8-888c-5a05e3f59da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.101337 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02762091-760c-40e8-888c-5a05e3f59da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.103124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02762091-760c-40e8-888c-5a05e3f59da3 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.114102 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1296/2567] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:06.118565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9675bf-8cfc-4a30-b3c6-ca2d995597c6 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.133924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9675bf-8cfc-4a30-b3c6-ca2d995597c6 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.139444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260024d-bb49-4afb-b5b3-f151027f8df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.140247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260024d-bb49-4afb-b5b3-f151027f8df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.140614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260024d-bb49-4afb-b5b3-f151027f8df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.140916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260024d-bb49-4afb-b5b3-f151027f8df2 admin admin] PATH_INFO: `/v3/projects/012ee5ee579b49b6a20790690cb1357f/users/e2fc6c3ec6d3456fb41b655c2e089e55/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.160911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260024d-bb49-4afb-b5b3-f151027f8df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012ee5ee579b49b6a20790690cb1357f, user_id=e2fc6c3ec6d3456fb41b655c2e089e55, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.168794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260024d-bb49-4afb-b5b3-f151027f8df2 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.194317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1272/2568] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:06 2022] PUT /identity/v3/projects/012ee5ee579b49b6a20790690cb1357f/users/e2fc6c3ec6d3456fb41b655c2e089e55/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:50:06.201323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7de90-f478-49d5-83c0-81429f378899 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.201804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7de90-f478-49d5-83c0-81429f378899 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.201804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7de90-f478-49d5-83c0-81429f378899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.232986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ccc7de90-f478-49d5-83c0-81429f378899 None None] MFA Rules not processed for user `e2fc6c3ec6d3456fb41b655c2e089e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:06.234248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ccc7de90-f478-49d5-83c0-81429f378899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:06.314563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:06.321680 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1297/2569] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:06.326201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260024d-bb49-4afb-b5b3-f151027f8df2 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.355798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:06.394828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260024d-bb49-4afb-b5b3-f151027f8df2 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.400585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681369c3-5be1-4465-82b8-7a2d4606ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.401316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681369c3-5be1-4465-82b8-7a2d4606ecf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.401660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681369c3-5be1-4465-82b8-7a2d4606ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.402210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681369c3-5be1-4465-82b8-7a2d4606ecf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.403123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681369c3-5be1-4465-82b8-7a2d4606ecf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.405288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681369c3-5be1-4465-82b8-7a2d4606ecf0 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.442144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1273/2570] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:06 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:50:06.443976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7de90-f478-49d5-83c0-81429f378899 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.454973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7de90-f478-49d5-83c0-81429f378899 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.516694 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cc72f-03de-4887-b23a-30513a1d3034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.517385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc72f-03de-4887-b23a-30513a1d3034 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.517766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc72f-03de-4887-b23a-30513a1d3034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.518085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc72f-03de-4887-b23a-30513a1d3034 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.518788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cc72f-03de-4887-b23a-30513a1d3034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.520749 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623cc72f-03de-4887-b23a-30513a1d3034 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.544961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1298/2571] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:06 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:06.546285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681369c3-5be1-4465-82b8-7a2d4606ecf0 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.557730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681369c3-5be1-4465-82b8-7a2d4606ecf0 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.563645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25e7e6-12cc-494a-8d6d-20b51cc27091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.564328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25e7e6-12cc-494a-8d6d-20b51cc27091 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.564611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25e7e6-12cc-494a-8d6d-20b51cc27091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.564908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25e7e6-12cc-494a-8d6d-20b51cc27091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.565741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25e7e6-12cc-494a-8d6d-20b51cc27091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.567476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25e7e6-12cc-494a-8d6d-20b51cc27091 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.579270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1274/2572] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:06.583582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cc72f-03de-4887-b23a-30513a1d3034 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.596129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cc72f-03de-4887-b23a-30513a1d3034 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.601153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd621-1d64-4403-b3ba-10cd098abf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.602169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd621-1d64-4403-b3ba-10cd098abf51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.602452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd621-1d64-4403-b3ba-10cd098abf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.602730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd621-1d64-4403-b3ba-10cd098abf51 admin admin] PATH_INFO: `/v3/projects/6abecb02d4394e198855c37bd557a3f0/users/bcefc46d46b34df693bb2bbd304d5966/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.618559 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcd621-1d64-4403-b3ba-10cd098abf51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abecb02d4394e198855c37bd557a3f0, user_id=bcefc46d46b34df693bb2bbd304d5966, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.621222 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcd621-1d64-4403-b3ba-10cd098abf51 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.636376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1299/2573] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:06 2022] PUT /identity/v3/projects/6abecb02d4394e198855c37bd557a3f0/users/bcefc46d46b34df693bb2bbd304d5966/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:50:06.640420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25e7e6-12cc-494a-8d6d-20b51cc27091 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.650556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25e7e6-12cc-494a-8d6d-20b51cc27091 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.710397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9c01b-11d9-4b37-b828-52e122a87854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.711073 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c01b-11d9-4b37-b828-52e122a87854 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.711355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c01b-11d9-4b37-b828-52e122a87854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.711630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c01b-11d9-4b37-b828-52e122a87854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.712417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9c01b-11d9-4b37-b828-52e122a87854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.714152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9c01b-11d9-4b37-b828-52e122a87854 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.724660 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1275/2574] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:06.729691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd621-1d64-4403-b3ba-10cd098abf51 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.741018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd621-1d64-4403-b3ba-10cd098abf51 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.746300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.747804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.748089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.748367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] PATH_INFO: `/v3/projects/6abecb02d4394e198855c37bd557a3f0/users/bcefc46d46b34df693bb2bbd304d5966/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.751301 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6abecb02d4394e198855c37bd557a3f0, user_id=bcefc46d46b34df693bb2bbd304d5966, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.753973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:06.765791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1300/2575] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:06 2022] PUT /identity/v3/projects/6abecb02d4394e198855c37bd557a3f0/users/bcefc46d46b34df693bb2bbd304d5966/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:06.776643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526bdf-8bfc-429e-9839-65eecf8325a7 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.777013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526bdf-8bfc-429e-9839-65eecf8325a7 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.777357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526bdf-8bfc-429e-9839-65eecf8325a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.806188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f1526bdf-8bfc-429e-9839-65eecf8325a7 None None] MFA Rules not processed for user `bcefc46d46b34df693bb2bbd304d5966`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:06.807395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f1526bdf-8bfc-429e-9839-65eecf8325a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:06.875121 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1276/2576] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:06.887018 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:06.888716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:06.961730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bc042-0049-40fc-8031-d5ea3f2ac8f0 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:06.967245 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:06.967994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:06.968708 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:06.969031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:06.982924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:06.984511 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:07.012957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1301/2577] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:07.408247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526bdf-8bfc-429e-9839-65eecf8325a7 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:07.434850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:07.484744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1526bdf-8bfc-429e-9839-65eecf8325a7 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:07.494990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:07.496541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:07.497003 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:07.498192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:07.498574 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:07.498857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] PATH_INFO: `/v3/users/e2fc6c3ec6d3456fb41b655c2e089e55` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:07.500077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fc6c3ec6d3456fb41b655c2e089e55)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:07.502059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:07.559607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c3f94-abc0-44ff-a73d-e8feba9edec1 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:07.561286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fc6c3ec6d3456fb41b655c2e089e55'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:07.562065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fc6c3ec6d3456fb41b655c2e089e55'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:07.563878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4bb8e-bdb5-4c4f-9428-e33e6a09d73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:07.565555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4bb8e-bdb5-4c4f-9428-e33e6a09d73b service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:07.565555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4bb8e-bdb5-4c4f-9428-e33e6a09d73b service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:07.565555 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4bb8e-bdb5-4c4f-9428-e33e6a09d73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:07.567515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6da4bb8e-bdb5-4c4f-9428-e33e6a09d73b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:07.574270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fc6c3ec6d3456fb41b655c2e089e55'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:07.580575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:07.583020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fc6c3ec6d3456fb41b655c2e089e55'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:07.586617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4bb8e-bdb5-4c4f-9428-e33e6a09d73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:07.588866 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4bb8e-bdb5-4c4f-9428-e33e6a09d73b service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:07.596547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fc6c3ec6d3456fb41b655c2e089e55'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:07.607214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1302/2579] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:07.607438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1277/2579] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:07 2022] DELETE /identity/v3/users/e2fc6c3ec6d3456fb41b655c2e089e55 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:07.608822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c62a8-e8e6-4056-bdfe-8cfff903a14d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:07.609492 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c62a8-e8e6-4056-bdfe-8cfff903a14d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:07.610199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c62a8-e8e6-4056-bdfe-8cfff903a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:07.628632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-0c7c62a8-e8e6-4056-bdfe-8cfff903a14d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:07.634394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0c7c62a8-e8e6-4056-bdfe-8cfff903a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:07.711214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1303/2580] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:07.723102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:07.724681 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:07.796759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeea4d-5fff-4cf6-a1ca-4e29402abd19 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:07.801998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3676-7795-4c8a-b90e-8ead7b20e58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:07.802777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3676-7795-4c8a-b90e-8ead7b20e58e service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:07.803173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3676-7795-4c8a-b90e-8ead7b20e58e service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:07.803542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b3676-7795-4c8a-b90e-8ead7b20e58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:07.814508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3676-7795-4c8a-b90e-8ead7b20e58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:07.816230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b3676-7795-4c8a-b90e-8ead7b20e58e service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:07.827927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1278/2581] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:50:08.419241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c62a8-e8e6-4056-bdfe-8cfff903a14d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:08.420773 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0c7c62a8-e8e6-4056-bdfe-8cfff903a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:08.434252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c62a8-e8e6-4056-bdfe-8cfff903a14d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:08.440597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:08.441698 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:08.444176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:08.444475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] PATH_INFO: `/v3/projects/012ee5ee579b49b6a20790690cb1357f` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:08.446765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012ee5ee579b49b6a20790690cb1357f)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:08.448738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:08.509295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012ee5ee579b49b6a20790690cb1357f', 'request_id': 'req-00c1372d-24e3-46cd-b0f9-202bbc94afd5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.520442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012ee5ee579b49b6a20790690cb1357f', 'request_id': 'req-00c1372d-24e3-46cd-b0f9-202bbc94afd5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.537400 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012ee5ee579b49b6a20790690cb1357f', 'request_id': 'req-00c1372d-24e3-46cd-b0f9-202bbc94afd5'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.554055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] The token cache is being invalidate because project 012ee5ee579b49b6a20790690cb1357f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:08.554403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.564072 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.566800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1304/2582] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:08 2022] DELETE /identity/v3/projects/012ee5ee579b49b6a20790690cb1357f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:08.571163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3676-7795-4c8a-b90e-8ead7b20e58e service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:08.585375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b3676-7795-4c8a-b90e-8ead7b20e58e service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:08.654862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:08.679804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:08.680711 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:08.681002 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:08.681277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] PATH_INFO: `/v3/users/bcefc46d46b34df693bb2bbd304d5966` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:08.682531 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcefc46d46b34df693bb2bbd304d5966)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:08.684528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:08.755014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcefc46d46b34df693bb2bbd304d5966'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.755946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcefc46d46b34df693bb2bbd304d5966'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.772368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcefc46d46b34df693bb2bbd304d5966'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.781381 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcefc46d46b34df693bb2bbd304d5966'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.800206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-95029d27-777c-4851-b799-c3648e100543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcefc46d46b34df693bb2bbd304d5966'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:08.808559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1279/2583] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:08 2022] DELETE /identity/v3/users/bcefc46d46b34df693bb2bbd304d5966 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:09.408035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:09.409554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:09.424194 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1372d-24e3-46cd-b0f9-202bbc94afd5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:09.548478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:09.549543 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:09.549972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:09.550377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] PATH_INFO: `/v3/projects/6abecb02d4394e198855c37bd557a3f0` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:09.551978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6abecb02d4394e198855c37bd557a3f0)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:09.555577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:09.589460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:09.623892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6abecb02d4394e198855c37bd557a3f0', 'request_id': 'req-05a20039-c48e-48e5-b30c-0556df1afb91'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:09.634787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6abecb02d4394e198855c37bd557a3f0', 'request_id': 'req-05a20039-c48e-48e5-b30c-0556df1afb91'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:09.642000 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6abecb02d4394e198855c37bd557a3f0', 'request_id': 'req-05a20039-c48e-48e5-b30c-0556df1afb91'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:09.656961 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] The token cache is being invalidate because project 6abecb02d4394e198855c37bd557a3f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:09.657846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:09.658384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-05a20039-c48e-48e5-b30c-0556df1afb91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:09.660125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1305/2584] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:09 2022] DELETE /identity/v3/projects/6abecb02d4394e198855c37bd557a3f0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:09.665064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6bd0-7769-43a3-9352-074f1314ff5e None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:09.665599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6bd0-7769-43a3-9352-074f1314ff5e None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:09.665687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6bd0-7769-43a3-9352-074f1314ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:09.685720 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-116e6bd0-7769-43a3-9352-074f1314ff5e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:09.687065 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-116e6bd0-7769-43a3-9352-074f1314ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:09.753915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1280/2585] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:09.761793 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531e7c-45d6-4128-a1c0-cbde9a46bab0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:09.762127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531e7c-45d6-4128-a1c0-cbde9a46bab0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:09.762391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e531e7c-45d6-4128-a1c0-cbde9a46bab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:09.781346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-5e531e7c-45d6-4128-a1c0-cbde9a46bab0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:09.782608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5e531e7c-45d6-4128-a1c0-cbde9a46bab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:09.794035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1306/2586] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:09.795172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e6bd0-7769-43a3-9352-074f1314ff5e None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:09.805135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e6bd0-7769-43a3-9352-074f1314ff5e None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:09.809802 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:09.810932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:09.810932 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:09.811163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:09.811735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:50:09.812039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:09.814662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:09.827742 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1281/2587] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:50:09.832484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e531e7c-45d6-4128-a1c0-cbde9a46bab0 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:09.844875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e531e7c-45d6-4128-a1c0-cbde9a46bab0 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:09.849840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118adfa6-c097-4d83-8059-64fa4540d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:09.850640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118adfa6-c097-4d83-8059-64fa4540d68c admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:09.850989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118adfa6-c097-4d83-8059-64fa4540d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:09.851411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118adfa6-c097-4d83-8059-64fa4540d68c admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:09.852192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118adfa6-c097-4d83-8059-64fa4540d68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:09.854348 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118adfa6-c097-4d83-8059-64fa4540d68c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:09.887148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1307/2588] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:09 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:09.891108 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:09.901192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47535fea-c523-47ac-b039-f897198540a9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:09.957324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:09.981843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae32e7f-7c28-4867-bd5e-833e945924e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:09.982587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32e7f-7c28-4867-bd5e-833e945924e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:09.982873 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32e7f-7c28-4867-bd5e-833e945924e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:09.983169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae32e7f-7c28-4867-bd5e-833e945924e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:09.983896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae32e7f-7c28-4867-bd5e-833e945924e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:09.985877 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae32e7f-7c28-4867-bd5e-833e945924e9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.008056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1282/2589] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:09 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:10.012092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118adfa6-c097-4d83-8059-64fa4540d68c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.022614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118adfa6-c097-4d83-8059-64fa4540d68c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.027558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7586fa0-36ac-4f65-a53a-fd2d6c6c4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.028311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7586fa0-36ac-4f65-a53a-fd2d6c6c4b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.028627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7586fa0-36ac-4f65-a53a-fd2d6c6c4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.028929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7586fa0-36ac-4f65-a53a-fd2d6c6c4b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.029784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7586fa0-36ac-4f65-a53a-fd2d6c6c4b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.032220 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7586fa0-36ac-4f65-a53a-fd2d6c6c4b62 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.043364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1308/2590] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:10.052452 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae32e7f-7c28-4867-bd5e-833e945924e9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.063623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae32e7f-7c28-4867-bd5e-833e945924e9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.069420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc83b-2495-4482-8236-312e440ae398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.069708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc83b-2495-4482-8236-312e440ae398 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.070050 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc83b-2495-4482-8236-312e440ae398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.070251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc83b-2495-4482-8236-312e440ae398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.071001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc83b-2495-4482-8236-312e440ae398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.072623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc83b-2495-4482-8236-312e440ae398 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.084041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1283/2591] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:10.088553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7586fa0-36ac-4f65-a53a-fd2d6c6c4b62 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.098577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7586fa0-36ac-4f65-a53a-fd2d6c6c4b62 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.103651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb45266-59e3-4869-913d-6adf111fb1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.104541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb45266-59e3-4869-913d-6adf111fb1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.104819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb45266-59e3-4869-913d-6adf111fb1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.105069 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb45266-59e3-4869-913d-6adf111fb1e5 admin admin] PATH_INFO: `/v3/projects/cf9d720af2ce4f17b1faa7df3548f25a/users/2a892b0f80ca45d29179c3f4062c4129/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.120211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb45266-59e3-4869-913d-6adf111fb1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9d720af2ce4f17b1faa7df3548f25a, user_id=2a892b0f80ca45d29179c3f4062c4129, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.122905 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb45266-59e3-4869-913d-6adf111fb1e5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.140133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1309/2592] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:10 2022] PUT /identity/v3/projects/cf9d720af2ce4f17b1faa7df3548f25a/users/2a892b0f80ca45d29179c3f4062c4129/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:10.151524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26497-1b66-4c57-99f5-19d43eb11460 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.151808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26497-1b66-4c57-99f5-19d43eb11460 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.152100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff26497-1b66-4c57-99f5-19d43eb11460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.180361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-dff26497-1b66-4c57-99f5-19d43eb11460 None None] MFA Rules not processed for user `2a892b0f80ca45d29179c3f4062c4129`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:10.181622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-dff26497-1b66-4c57-99f5-19d43eb11460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:10.250792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1284/2593] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:10.255703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb45266-59e3-4869-913d-6adf111fb1e5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.335257 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb45266-59e3-4869-913d-6adf111fb1e5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.342391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea21c39-74b3-4a8a-80d0-22912914dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.343116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea21c39-74b3-4a8a-80d0-22912914dea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.343403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea21c39-74b3-4a8a-80d0-22912914dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.343679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea21c39-74b3-4a8a-80d0-22912914dea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.344388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea21c39-74b3-4a8a-80d0-22912914dea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.346408 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea21c39-74b3-4a8a-80d0-22912914dea9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.376859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1310/2594] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:10 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:10.380896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26497-1b66-4c57-99f5-19d43eb11460 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.393083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff26497-1b66-4c57-99f5-19d43eb11460 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.451990 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c31a-b70c-4ff8-a1f6-cbdd4988ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.452675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c31a-b70c-4ff8-a1f6-cbdd4988ca4b admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.452960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c31a-b70c-4ff8-a1f6-cbdd4988ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.453282 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c31a-b70c-4ff8-a1f6-cbdd4988ca4b admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.454077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c31a-b70c-4ff8-a1f6-cbdd4988ca4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.456115 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c31a-b70c-4ff8-a1f6-cbdd4988ca4b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.480470 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1285/2595] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:10 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:50:10.481833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea21c39-74b3-4a8a-80d0-22912914dea9 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.493338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea21c39-74b3-4a8a-80d0-22912914dea9 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.502087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeda23-b54f-48e1-9888-c77785b7cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.502988 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeda23-b54f-48e1-9888-c77785b7cff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.503305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeda23-b54f-48e1-9888-c77785b7cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.503589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeda23-b54f-48e1-9888-c77785b7cff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.504424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeda23-b54f-48e1-9888-c77785b7cff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.506112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeda23-b54f-48e1-9888-c77785b7cff2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.518279 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1311/2596] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:10.522806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c31a-b70c-4ff8-a1f6-cbdd4988ca4b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.533173 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c31a-b70c-4ff8-a1f6-cbdd4988ca4b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.537766 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d0c5-cef3-4223-b74c-891cfefe3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.538749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d0c5-cef3-4223-b74c-891cfefe3980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.539032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d0c5-cef3-4223-b74c-891cfefe3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.539310 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d0c5-cef3-4223-b74c-891cfefe3980 admin admin] PATH_INFO: `/v3/projects/5713ed3213b74e26acfea64e5da91b81/users/d84c3fa2d23f4964b4980deec8d36ad7/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.556729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0d0c5-cef3-4223-b74c-891cfefe3980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5713ed3213b74e26acfea64e5da91b81, user_id=d84c3fa2d23f4964b4980deec8d36ad7, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.559689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0d0c5-cef3-4223-b74c-891cfefe3980 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.579259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1286/2597] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:10 2022] PUT /identity/v3/projects/5713ed3213b74e26acfea64e5da91b81/users/d84c3fa2d23f4964b4980deec8d36ad7/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:50:10.583483 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeda23-b54f-48e1-9888-c77785b7cff2 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.595286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeda23-b54f-48e1-9888-c77785b7cff2 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.614836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:10.662774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b101d-1e29-425d-9610-df5cb4941b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.663626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b101d-1e29-425d-9610-df5cb4941b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.663975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b101d-1e29-425d-9610-df5cb4941b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.664317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b101d-1e29-425d-9610-df5cb4941b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.665123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b101d-1e29-425d-9610-df5cb4941b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.666903 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b101d-1e29-425d-9610-df5cb4941b15 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.681741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1312/2598] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:10.682944 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d0c5-cef3-4223-b74c-891cfefe3980 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.695879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d0c5-cef3-4223-b74c-891cfefe3980 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.703921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.705164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.705804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.706220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] PATH_INFO: `/v3/projects/5713ed3213b74e26acfea64e5da91b81/users/d84c3fa2d23f4964b4980deec8d36ad7/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.709131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5713ed3213b74e26acfea64e5da91b81, user_id=d84c3fa2d23f4964b4980deec8d36ad7, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.716197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.740190 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baad1e7-0c76-4d08-bc6a-047db627f5cb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.740746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baad1e7-0c76-4d08-bc6a-047db627f5cb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.741179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baad1e7-0c76-4d08-bc6a-047db627f5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.743834 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1287/2599] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:10 2022] PUT /identity/v3/projects/5713ed3213b74e26acfea64e5da91b81/users/d84c3fa2d23f4964b4980deec8d36ad7/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:10.776794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-2baad1e7-0c76-4d08-bc6a-047db627f5cb None None] MFA Rules not processed for user `d84c3fa2d23f4964b4980deec8d36ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:10.778176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2baad1e7-0c76-4d08-bc6a-047db627f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:10.857309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1313/2600] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:10.874527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:10.876349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:10.888443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:10.957235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7fdda-5fc6-459f-a128-c8d96f6e6cf1 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:10.961694 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ae41-95a2-483f-b995-a434d97794d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:10.962662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ae41-95a2-483f-b995-a434d97794d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:10.963082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ae41-95a2-483f-b995-a434d97794d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:10.963412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb16ae41-95a2-483f-b995-a434d97794d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:10.977519 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16ae41-95a2-483f-b995-a434d97794d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:10.981711 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb16ae41-95a2-483f-b995-a434d97794d3 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:10.995064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1288/2601] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:11.295387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baad1e7-0c76-4d08-bc6a-047db627f5cb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:11.297218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2baad1e7-0c76-4d08-bc6a-047db627f5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:11.378971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baad1e7-0c76-4d08-bc6a-047db627f5cb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:11.385457 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:11.386874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.387186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.387464 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] PATH_INFO: `/v3/users/3229929e0f2f4c9fbb3dc6413b6db151` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.388678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3229929e0f2f4c9fbb3dc6413b6db151)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:11.390685 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:11.438010 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:11.440841 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3229929e0f2f4c9fbb3dc6413b6db151'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.453129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3229929e0f2f4c9fbb3dc6413b6db151'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.453827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3229929e0f2f4c9fbb3dc6413b6db151'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.462459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3229929e0f2f4c9fbb3dc6413b6db151'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.475706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3229929e0f2f4c9fbb3dc6413b6db151'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.481974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1314/2602] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:11 2022] DELETE /identity/v3/users/3229929e0f2f4c9fbb3dc6413b6db151 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:11.531589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ae41-95a2-483f-b995-a434d97794d3 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:11.541925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb16ae41-95a2-483f-b995-a434d97794d3 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:11.601575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:11.602571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.602879 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.603152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] PATH_INFO: `/v3/users/2a892b0f80ca45d29179c3f4062c4129` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.604350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a892b0f80ca45d29179c3f4062c4129)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:11.606318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:11.655616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:11.657307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:11.659870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a892b0f80ca45d29179c3f4062c4129'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.660522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a892b0f80ca45d29179c3f4062c4129'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.672355 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a892b0f80ca45d29179c3f4062c4129'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.673300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdf390-3750-49c0-8715-b2bdb27e258c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:11.678703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:11.679788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.680129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.680575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] PATH_INFO: `/v3/projects/7d037922bcac4bc6babcd8183982073e` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.681925 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a892b0f80ca45d29179c3f4062c4129'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.682407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d037922bcac4bc6babcd8183982073e)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:11.684837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:11.696841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8565c1da-4933-4a24-ac32-db1dce745656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a892b0f80ca45d29179c3f4062c4129'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.702933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1289/2603] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:11 2022] DELETE /identity/v3/users/2a892b0f80ca45d29179c3f4062c4129 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:11.707559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c559038-483c-4a0b-83a9-b4d0d4c3eedc None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.707848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c559038-483c-4a0b-83a9-b4d0d4c3eedc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.708125 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c559038-483c-4a0b-83a9-b4d0d4c3eedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.729642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0c559038-483c-4a0b-83a9-b4d0d4c3eedc None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:11.731151 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0c559038-483c-4a0b-83a9-b4d0d4c3eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:11.742771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d037922bcac4bc6babcd8183982073e', 'request_id': 'req-08341b41-6391-4d7e-83f3-496b85446325'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.752970 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d037922bcac4bc6babcd8183982073e', 'request_id': 'req-08341b41-6391-4d7e-83f3-496b85446325'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.758738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:11.759611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d037922bcac4bc6babcd8183982073e', 'request_id': 'req-08341b41-6391-4d7e-83f3-496b85446325'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.771606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] The token cache is being invalidate because project 7d037922bcac4bc6babcd8183982073e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:11.771899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.772585 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-08341b41-6391-4d7e-83f3-496b85446325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:11.774270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1315/2604] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:11 2022] DELETE /identity/v3/projects/7d037922bcac4bc6babcd8183982073e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:11.779627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ef43-528a-4064-b508-746507c86a57 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.779983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ef43-528a-4064-b508-746507c86a57 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.780322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6ef43-528a-4064-b508-746507c86a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.798531 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1290/2605] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:50:11.800122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8bb6ef43-528a-4064-b508-746507c86a57 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:11.801479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8bb6ef43-528a-4064-b508-746507c86a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:11.808267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c559038-483c-4a0b-83a9-b4d0d4c3eedc None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:11.809582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0c559038-483c-4a0b-83a9-b4d0d4c3eedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:11.816086 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1316/2606] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:11.817669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7eddd-d3e8-4c00-9ce1-40d10c0b061a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.818344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7eddd-d3e8-4c00-9ce1-40d10c0b061a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.818616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7eddd-d3e8-4c00-9ce1-40d10c0b061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.837827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-57a7eddd-d3e8-4c00-9ce1-40d10c0b061a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:11.839068 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-57a7eddd-d3e8-4c00-9ce1-40d10c0b061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:11.847130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1317/2607] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:50:11.851293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7eddd-d3e8-4c00-9ce1-40d10c0b061a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:11.860621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7eddd-d3e8-4c00-9ce1-40d10c0b061a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:11.865471 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:11.866172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.866453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.866758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.867517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:50:11.867822 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:11.868705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c559038-483c-4a0b-83a9-b4d0d4c3eedc None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:11.869465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:11.872573 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e703f-11d8-44dd-8654-e99390150999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:11.873219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e703f-11d8-44dd-8654-e99390150999 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.873503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e703f-11d8-44dd-8654-e99390150999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.873778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e703f-11d8-44dd-8654-e99390150999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.881525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1318/2608] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:50:11.883324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e703f-11d8-44dd-8654-e99390150999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:11.884759 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e703f-11d8-44dd-8654-e99390150999 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:11.885803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:11.894686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1291/2609] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:50:11.895674 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c48089-252b-40f6-b06c-c4cdce1a75d0 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:11.900501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a90a4-baf7-4246-b7b0-3b643fc1bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:11.901146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a90a4-baf7-4246-b7b0-3b643fc1bd07 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:11.901577 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a90a4-baf7-4246-b7b0-3b643fc1bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:11.901691 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a90a4-baf7-4246-b7b0-3b643fc1bd07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:11.902436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a90a4-baf7-4246-b7b0-3b643fc1bd07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:11.904505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a90a4-baf7-4246-b7b0-3b643fc1bd07 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:11.935659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1319/2610] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:11 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:11.937117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e703f-11d8-44dd-8654-e99390150999 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:11.947888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e703f-11d8-44dd-8654-e99390150999 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.007669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2870dd1-dfff-4cac-a315-28f433ae58b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.008346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2870dd1-dfff-4cac-a315-28f433ae58b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.008626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2870dd1-dfff-4cac-a315-28f433ae58b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.008895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2870dd1-dfff-4cac-a315-28f433ae58b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.009605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2870dd1-dfff-4cac-a315-28f433ae58b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.011535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2870dd1-dfff-4cac-a315-28f433ae58b3 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.036650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1292/2611] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:11 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:12.042820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a90a4-baf7-4246-b7b0-3b643fc1bd07 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.073572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a90a4-baf7-4246-b7b0-3b643fc1bd07 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.080788 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213d52c-abed-4ef3-b6cf-d8fe9c5b04f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.081996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d52c-abed-4ef3-b6cf-d8fe9c5b04f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.082844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d52c-abed-4ef3-b6cf-d8fe9c5b04f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.083139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213d52c-abed-4ef3-b6cf-d8fe9c5b04f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.083914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213d52c-abed-4ef3-b6cf-d8fe9c5b04f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.085514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213d52c-abed-4ef3-b6cf-d8fe9c5b04f2 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.098003 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1320/2612] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:12.100510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2870dd1-dfff-4cac-a315-28f433ae58b3 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.111051 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2870dd1-dfff-4cac-a315-28f433ae58b3 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.115749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c657-83f4-49f8-abe7-3bd7d02f0db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.116523 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c657-83f4-49f8-abe7-3bd7d02f0db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.116904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c657-83f4-49f8-abe7-3bd7d02f0db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.117246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c657-83f4-49f8-abe7-3bd7d02f0db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.118090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4c657-83f4-49f8-abe7-3bd7d02f0db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.119791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4c657-83f4-49f8-abe7-3bd7d02f0db7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.133669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1293/2613] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:50:12.134915 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213d52c-abed-4ef3-b6cf-d8fe9c5b04f2 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.144989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213d52c-abed-4ef3-b6cf-d8fe9c5b04f2 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.150389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.151305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.151589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.151867 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] PATH_INFO: `/v3/projects/f512ea6e47284d859e225ef77eb8f28e/users/8e6bd77c882840c4a91e07537bbe5b50/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.167427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f512ea6e47284d859e225ef77eb8f28e, user_id=8e6bd77c882840c4a91e07537bbe5b50, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.170210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.185444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1321/2614] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:12 2022] PUT /identity/v3/projects/f512ea6e47284d859e225ef77eb8f28e/users/8e6bd77c882840c4a91e07537bbe5b50/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:12.196926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6876-1b1a-46b8-8889-3eb4a6f44dc6 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.197222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6876-1b1a-46b8-8889-3eb4a6f44dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.197506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6876-1b1a-46b8-8889-3eb4a6f44dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.225210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-16da6876-1b1a-46b8-8889-3eb4a6f44dc6 None None] MFA Rules not processed for user `8e6bd77c882840c4a91e07537bbe5b50`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:12.226667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-16da6876-1b1a-46b8-8889-3eb4a6f44dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:12.264237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.266460 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:12.281773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:12.290446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:12.312896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1294/2615] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:12.317014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da6876-1b1a-46b8-8889-3eb4a6f44dc6 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.338382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d4ff1-0d0a-4bb8-bdcf-611a11681d28 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.343210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.344114 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.344391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.344665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] PATH_INFO: `/v3/projects/cf9d720af2ce4f17b1faa7df3548f25a` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.346313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9d720af2ce4f17b1faa7df3548f25a)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.348482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.380040 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da6876-1b1a-46b8-8889-3eb4a6f44dc6 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.384793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af020a-87ae-4772-ad0f-05f05642fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.385448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af020a-87ae-4772-ad0f-05f05642fad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.385726 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af020a-87ae-4772-ad0f-05f05642fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.386025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af020a-87ae-4772-ad0f-05f05642fad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.386718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af020a-87ae-4772-ad0f-05f05642fad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.388623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af020a-87ae-4772-ad0f-05f05642fad8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.396159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9d720af2ce4f17b1faa7df3548f25a', 'request_id': 'req-581dd805-266d-4b24-9187-0925374a5c43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.405375 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9d720af2ce4f17b1faa7df3548f25a', 'request_id': 'req-581dd805-266d-4b24-9187-0925374a5c43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.412035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9d720af2ce4f17b1faa7df3548f25a', 'request_id': 'req-581dd805-266d-4b24-9187-0925374a5c43'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.414810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1295/2616] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:12 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:50:12.418844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af020a-87ae-4772-ad0f-05f05642fad8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.423609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] The token cache is being invalidate because project cf9d720af2ce4f17b1faa7df3548f25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:12.423893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.424552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.426145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1322/2617] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:12 2022] DELETE /identity/v3/projects/cf9d720af2ce4f17b1faa7df3548f25a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:12.429858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.431313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:12.480202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af020a-87ae-4772-ad0f-05f05642fad8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.485069 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.485741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.486048 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.486323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.487015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.488938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.495617 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd805-266d-4b24-9187-0925374a5c43 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.501316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.502235 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.502517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.502786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] PATH_INFO: `/v3/users/d84c3fa2d23f4964b4980deec8d36ad7` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.504006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84c3fa2d23f4964b4980deec8d36ad7)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.505927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.510918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1296/2618] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:12 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:50:12.514557 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.516418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:12.528551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f880992d-62c9-42d9-af17-1ab9a6333b13 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.533641 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168834-26a1-4472-af20-a0fc0ce52926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.534328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168834-26a1-4472-af20-a0fc0ce52926 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.534611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168834-26a1-4472-af20-a0fc0ce52926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.534903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168834-26a1-4472-af20-a0fc0ce52926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.535610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e168834-26a1-4472-af20-a0fc0ce52926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.537228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e168834-26a1-4472-af20-a0fc0ce52926 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.549983 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1297/2619] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:50:12.553129 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168834-26a1-4472-af20-a0fc0ce52926 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.556975 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84c3fa2d23f4964b4980deec8d36ad7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.560713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:12.563067 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168834-26a1-4472-af20-a0fc0ce52926 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.565880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84c3fa2d23f4964b4980deec8d36ad7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.566764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84c3fa2d23f4964b4980deec8d36ad7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.568527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6189d-d220-43ba-bd41-dc930569d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.569447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6189d-d220-43ba-bd41-dc930569d995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.569765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6189d-d220-43ba-bd41-dc930569d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.570126 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6189d-d220-43ba-bd41-dc930569d995 admin admin] PATH_INFO: `/v3/projects/8defb027355c4bb9a9526641243147aa/users/ccb958c528f949a28afc2ddf3ad9d491/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.576549 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84c3fa2d23f4964b4980deec8d36ad7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.589395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84c3fa2d23f4964b4980deec8d36ad7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:12.589611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6189d-d220-43ba-bd41-dc930569d995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8defb027355c4bb9a9526641243147aa, user_id=ccb958c528f949a28afc2ddf3ad9d491, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.592192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc6189d-d220-43ba-bd41-dc930569d995 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.595745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1323/2620] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:12 2022] DELETE /identity/v3/users/d84c3fa2d23f4964b4980deec8d36ad7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:12.609693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1298/2621] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:12 2022] PUT /identity/v3/projects/8defb027355c4bb9a9526641243147aa/users/ccb958c528f949a28afc2ddf3ad9d491/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:50:12.613919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.615462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:12.689918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7112f-d239-40fe-885e-9a007c62ceae admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.753488 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f652743-340d-4359-90d8-130c9c41189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.754252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f652743-340d-4359-90d8-130c9c41189e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.754563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f652743-340d-4359-90d8-130c9c41189e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.754797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f652743-340d-4359-90d8-130c9c41189e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.755772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f652743-340d-4359-90d8-130c9c41189e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.758107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f652743-340d-4359-90d8-130c9c41189e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.772324 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1324/2622] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:12.773629 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6189d-d220-43ba-bd41-dc930569d995 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.784120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6189d-d220-43ba-bd41-dc930569d995 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.789476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.790407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.790689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.790962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] PATH_INFO: `/v3/projects/8defb027355c4bb9a9526641243147aa/users/ccb958c528f949a28afc2ddf3ad9d491/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.792975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8defb027355c4bb9a9526641243147aa, user_id=ccb958c528f949a28afc2ddf3ad9d491, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.795662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:12.809538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1299/2623] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:12 2022] PUT /identity/v3/projects/8defb027355c4bb9a9526641243147aa/users/ccb958c528f949a28afc2ddf3ad9d491/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:12.820046 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c1823-fa32-449a-a0be-1b0d66bd4429 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.820342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c1823-fa32-449a-a0be-1b0d66bd4429 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.820674 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c1823-fa32-449a-a0be-1b0d66bd4429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.850803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1a3c1823-fa32-449a-a0be-1b0d66bd4429 None None] MFA Rules not processed for user `ccb958c528f949a28afc2ddf3ad9d491`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:12.852059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1a3c1823-fa32-449a-a0be-1b0d66bd4429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:12.872642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.874442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:12.884801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:12.929444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:12.940412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1325/2624] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:12.951628 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c1823-fa32-449a-a0be-1b0d66bd4429 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:12.953386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1a3c1823-fa32-449a-a0be-1b0d66bd4429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:12.973689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b014eb-0e94-45a1-bf78-62d78e1a291c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:12.980276 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:12.981662 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:12.982213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:12.982718 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] PATH_INFO: `/v3/projects/5713ed3213b74e26acfea64e5da91b81` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:12.984677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5713ed3213b74e26acfea64e5da91b81)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:12.986933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.021924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c1823-fa32-449a-a0be-1b0d66bd4429 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.026396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ef9dc-fd7b-4f3c-83e4-cec6a505f55f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.027608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef9dc-fd7b-4f3c-83e4-cec6a505f55f service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.028134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef9dc-fd7b-4f3c-83e4-cec6a505f55f service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.028485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ef9dc-fd7b-4f3c-83e4-cec6a505f55f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.040342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ef9dc-fd7b-4f3c-83e4-cec6a505f55f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.041836 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ef9dc-fd7b-4f3c-83e4-cec6a505f55f service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.053233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1326/2625] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:50:13.062745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5713ed3213b74e26acfea64e5da91b81', 'request_id': 'req-6f441dbb-d1bb-4185-82a2-3248d212a965'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:13.072708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5713ed3213b74e26acfea64e5da91b81', 'request_id': 'req-6f441dbb-d1bb-4185-82a2-3248d212a965'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:13.079821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5713ed3213b74e26acfea64e5da91b81', 'request_id': 'req-6f441dbb-d1bb-4185-82a2-3248d212a965'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:13.093037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] The token cache is being invalidate because project 5713ed3213b74e26acfea64e5da91b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:13.093993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:13.094230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:13.099076 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1300/2626] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:12 2022] DELETE /identity/v3/projects/5713ed3213b74e26acfea64e5da91b81 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:50:13.100852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed14f99-b859-4ea3-9986-786ccbd27ec8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.101287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed14f99-b859-4ea3-9986-786ccbd27ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.102229 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed14f99-b859-4ea3-9986-786ccbd27ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.121591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-bed14f99-b859-4ea3-9986-786ccbd27ec8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:13.122821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bed14f99-b859-4ea3-9986-786ccbd27ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:13.143438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.145354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:13.187813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1327/2627] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:13.195983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ccb95-a9dd-4cae-af94-d5758b53484d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.196270 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ccb95-a9dd-4cae-af94-d5758b53484d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.196552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ccb95-a9dd-4cae-af94-d5758b53484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.207327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f441dbb-d1bb-4185-82a2-3248d212a965 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.211376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.212014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.212290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.212562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.214364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:13.214678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-0b4ccb95-a9dd-4cae-af94-d5758b53484d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:13.215828 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0b4ccb95-a9dd-4cae-af94-d5758b53484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:13.223709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1328/2628] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:50:13.227779 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ccb95-a9dd-4cae-af94-d5758b53484d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.236590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ccb95-a9dd-4cae-af94-d5758b53484d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.245765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.246534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.246856 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.247134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.247873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:50:13.248206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.249884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.262470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1329/2629] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:50:13.266386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.266535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:13.277006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770ffb8-09d3-4c7d-ab05-3e35a5aa9ac3 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.278351 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.280947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.284825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9febf-4dd2-47e1-b1b3-a3680c370600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.286195 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9febf-4dd2-47e1-b1b3-a3680c370600 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.286478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9febf-4dd2-47e1-b1b3-a3680c370600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.287569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9febf-4dd2-47e1-b1b3-a3680c370600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.288281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9febf-4dd2-47e1-b1b3-a3680c370600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.290540 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9febf-4dd2-47e1-b1b3-a3680c370600 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.292239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1301/2630] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:50:13.332211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1330/2631] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:13 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:13.335964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.347758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd98b49-c743-404f-a2f4-a09c0a2e1fca service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.433404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e276-36a4-4781-b457-943145a2831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.434762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e276-36a4-4781-b457-943145a2831c admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.435360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e276-36a4-4781-b457-943145a2831c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.436026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4e276-36a4-4781-b457-943145a2831c admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.436949 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4e276-36a4-4781-b457-943145a2831c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.439041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4e276-36a4-4781-b457-943145a2831c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.465814 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1302/2632] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:13 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:13.469797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9febf-4dd2-47e1-b1b3-a3680c370600 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.480047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9febf-4dd2-47e1-b1b3-a3680c370600 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.484587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f000d-69c2-4103-aec2-c1a192284d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.485268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f000d-69c2-4103-aec2-c1a192284d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.485553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f000d-69c2-4103-aec2-c1a192284d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.485833 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f000d-69c2-4103-aec2-c1a192284d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.486607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f000d-69c2-4103-aec2-c1a192284d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.488248 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f000d-69c2-4103-aec2-c1a192284d5e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.498806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1331/2633] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:50:13.503100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e276-36a4-4781-b457-943145a2831c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.514105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4e276-36a4-4781-b457-943145a2831c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.519635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc725853-d093-41e1-8b46-d92e33f1e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.520308 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725853-d093-41e1-8b46-d92e33f1e724 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.520616 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725853-d093-41e1-8b46-d92e33f1e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.521039 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc725853-d093-41e1-8b46-d92e33f1e724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.521973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc725853-d093-41e1-8b46-d92e33f1e724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.523631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc725853-d093-41e1-8b46-d92e33f1e724 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.534849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1303/2634] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:13.539127 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f000d-69c2-4103-aec2-c1a192284d5e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.550787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f000d-69c2-4103-aec2-c1a192284d5e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.557572 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395448b-01f9-49df-a87e-cef4c1ff968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.558495 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395448b-01f9-49df-a87e-cef4c1ff968f admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.558799 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395448b-01f9-49df-a87e-cef4c1ff968f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.559056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395448b-01f9-49df-a87e-cef4c1ff968f admin admin] PATH_INFO: `/v3/projects/c199071ef02045e9aa5e06be0a1f0f04/users/46df53ef84dd4700a4f81e7c4054401b/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.575551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395448b-01f9-49df-a87e-cef4c1ff968f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c199071ef02045e9aa5e06be0a1f0f04, user_id=46df53ef84dd4700a4f81e7c4054401b, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.578418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395448b-01f9-49df-a87e-cef4c1ff968f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.593364 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1332/2635] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:13 2022] PUT /identity/v3/projects/c199071ef02045e9aa5e06be0a1f0f04/users/46df53ef84dd4700a4f81e7c4054401b/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:13.606567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce3f6-2a92-47a0-b2e2-2bb49316859b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.606855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce3f6-2a92-47a0-b2e2-2bb49316859b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.607186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ce3f6-2a92-47a0-b2e2-2bb49316859b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.633782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-934ce3f6-2a92-47a0-b2e2-2bb49316859b None None] MFA Rules not processed for user `46df53ef84dd4700a4f81e7c4054401b`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:13.635026 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-934ce3f6-2a92-47a0-b2e2-2bb49316859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:13.699360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1304/2636] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:13.704203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395448b-01f9-49df-a87e-cef4c1ff968f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.732065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:13.768521 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395448b-01f9-49df-a87e-cef4c1ff968f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.774357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dec30-6606-4985-b963-dea7251e92e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.775373 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dec30-6606-4985-b963-dea7251e92e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.775742 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dec30-6606-4985-b963-dea7251e92e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.776058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dec30-6606-4985-b963-dea7251e92e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.777119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dec30-6606-4985-b963-dea7251e92e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.780225 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dec30-6606-4985-b963-dea7251e92e7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.815384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1333/2637] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:13 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:13.820116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ce3f6-2a92-47a0-b2e2-2bb49316859b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.832041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ce3f6-2a92-47a0-b2e2-2bb49316859b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.895390 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a549d5f-709e-46e0-a2d4-d55fbf98e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.896309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a549d5f-709e-46e0-a2d4-d55fbf98e75f admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.896674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a549d5f-709e-46e0-a2d4-d55fbf98e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.897095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a549d5f-709e-46e0-a2d4-d55fbf98e75f admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.898258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a549d5f-709e-46e0-a2d4-d55fbf98e75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.900256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a549d5f-709e-46e0-a2d4-d55fbf98e75f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.907214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:13.923875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1305/2638] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:13 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:13.928087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dec30-6606-4985-b963-dea7251e92e7 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.939092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dec30-6606-4985-b963-dea7251e92e7 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.944969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c77ff2-7a94-4247-859e-dfb8788a72fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.945668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c77ff2-7a94-4247-859e-dfb8788a72fe admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.945964 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c77ff2-7a94-4247-859e-dfb8788a72fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.946315 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c77ff2-7a94-4247-859e-dfb8788a72fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:13.947051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c77ff2-7a94-4247-859e-dfb8788a72fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:13.948663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c77ff2-7a94-4247-859e-dfb8788a72fe admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:13.960281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1334/2639] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:13.964956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a549d5f-709e-46e0-a2d4-d55fbf98e75f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:13.976110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a549d5f-709e-46e0-a2d4-d55fbf98e75f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:13.983425 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a5d6b-0872-4e2e-9590-c5fc015d040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:13.984805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5d6b-0872-4e2e-9590-c5fc015d040c admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:13.985195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5d6b-0872-4e2e-9590-c5fc015d040c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:13.985595 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a5d6b-0872-4e2e-9590-c5fc015d040c admin admin] PATH_INFO: `/v3/projects/f4b0f1b8095d4555be9c1e54283dcd85/users/88fb0bd476f44467be9ffe6cf68aef4b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:14.003721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a5d6b-0872-4e2e-9590-c5fc015d040c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b0f1b8095d4555be9c1e54283dcd85, user_id=88fb0bd476f44467be9ffe6cf68aef4b, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:14.006558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a5d6b-0872-4e2e-9590-c5fc015d040c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:14.021270 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1306/2640] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:13 2022] PUT /identity/v3/projects/f4b0f1b8095d4555be9c1e54283dcd85/users/88fb0bd476f44467be9ffe6cf68aef4b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:14.025352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c77ff2-7a94-4247-859e-dfb8788a72fe admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:14.035649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c77ff2-7a94-4247-859e-dfb8788a72fe admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:14.100568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49f39b-63f2-405c-8353-785b4133835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:14.101303 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49f39b-63f2-405c-8353-785b4133835d admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:14.101593 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49f39b-63f2-405c-8353-785b4133835d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:14.101872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49f39b-63f2-405c-8353-785b4133835d admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:14.102656 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49f39b-63f2-405c-8353-785b4133835d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:14.104306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49f39b-63f2-405c-8353-785b4133835d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:14.114721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1335/2641] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:14.119183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a5d6b-0872-4e2e-9590-c5fc015d040c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:14.129965 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a5d6b-0872-4e2e-9590-c5fc015d040c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:14.135077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba875-908b-4808-bfd2-8ce2c261f47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:14.135991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba875-908b-4808-bfd2-8ce2c261f47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:14.136271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba875-908b-4808-bfd2-8ce2c261f47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:14.136550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ba875-908b-4808-bfd2-8ce2c261f47e admin admin] PATH_INFO: `/v3/projects/f4b0f1b8095d4555be9c1e54283dcd85/users/88fb0bd476f44467be9ffe6cf68aef4b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:14.138607 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ba875-908b-4808-bfd2-8ce2c261f47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b0f1b8095d4555be9c1e54283dcd85, user_id=88fb0bd476f44467be9ffe6cf68aef4b, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:14.141247 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ba875-908b-4808-bfd2-8ce2c261f47e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:14.152636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1307/2642] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:14 2022] PUT /identity/v3/projects/f4b0f1b8095d4555be9c1e54283dcd85/users/88fb0bd476f44467be9ffe6cf68aef4b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:14.163119 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0790f7-5fc9-4758-ae06-3996eb7bbae4 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:14.163411 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0790f7-5fc9-4758-ae06-3996eb7bbae4 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:14.163686 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0790f7-5fc9-4758-ae06-3996eb7bbae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:14.189532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ed0790f7-5fc9-4758-ae06-3996eb7bbae4 None None] MFA Rules not processed for user `88fb0bd476f44467be9ffe6cf68aef4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:14.190745 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ed0790f7-5fc9-4758-ae06-3996eb7bbae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:14.260986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1336/2643] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:14.272683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba875-908b-4808-bfd2-8ce2c261f47e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:14.335843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ba875-908b-4808-bfd2-8ce2c261f47e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:14.339958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab674d-96fd-4442-9ed8-e9dc8d8923e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:14.340630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab674d-96fd-4442-9ed8-e9dc8d8923e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:14.340916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab674d-96fd-4442-9ed8-e9dc8d8923e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:14.341197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab674d-96fd-4442-9ed8-e9dc8d8923e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:14.351094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab674d-96fd-4442-9ed8-e9dc8d8923e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:14.352502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab674d-96fd-4442-9ed8-e9dc8d8923e8 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:14.362245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1308/2644] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:14.429135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0790f7-5fc9-4758-ae06-3996eb7bbae4 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:14.451898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:14.500941 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0790f7-5fc9-4758-ae06-3996eb7bbae4 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:14.506477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:14.507448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:14.507735 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:14.508014 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] PATH_INFO: `/v3/users/46df53ef84dd4700a4f81e7c4054401b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:14.509505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46df53ef84dd4700a4f81e7c4054401b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:14.511475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:14.568546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46df53ef84dd4700a4f81e7c4054401b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:14.578940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46df53ef84dd4700a4f81e7c4054401b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:14.579576 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46df53ef84dd4700a4f81e7c4054401b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:14.587859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46df53ef84dd4700a4f81e7c4054401b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:14.603642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46df53ef84dd4700a4f81e7c4054401b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:14.611497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1337/2645] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:14 2022] DELETE /identity/v3/users/46df53ef84dd4700a4f81e7c4054401b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:14.615805 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660beb2-40ca-49ff-9a8e-a47b38b2d202 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:14.616094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660beb2-40ca-49ff-9a8e-a47b38b2d202 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:14.616376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660beb2-40ca-49ff-9a8e-a47b38b2d202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:14.641228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5660beb2-40ca-49ff-9a8e-a47b38b2d202 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:14.642513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5660beb2-40ca-49ff-9a8e-a47b38b2d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:14.711536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1309/2646] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:14.722139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:14.723632 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:14.787177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3686f9-d5b5-4e09-af3e-4310f6857482 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:14.791156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42676-f273-4bf2-ae12-565d3345e688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:14.791887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42676-f273-4bf2-ae12-565d3345e688 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:14.792253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42676-f273-4bf2-ae12-565d3345e688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:14.792660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42676-f273-4bf2-ae12-565d3345e688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:14.805122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42676-f273-4bf2-ae12-565d3345e688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:14.806651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42676-f273-4bf2-ae12-565d3345e688 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:14.816683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1338/2647] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:15.117248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660beb2-40ca-49ff-9a8e-a47b38b2d202 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:15.118783 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5660beb2-40ca-49ff-9a8e-a47b38b2d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:15.131241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660beb2-40ca-49ff-9a8e-a47b38b2d202 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:15.137189 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:15.138216 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:15.138598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:15.138974 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] PATH_INFO: `/v3/projects/c199071ef02045e9aa5e06be0a1f0f04` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:15.140290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c199071ef02045e9aa5e06be0a1f0f04)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:15.142542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:15.197016 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c199071ef02045e9aa5e06be0a1f0f04', 'request_id': 'req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.198920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:15.207273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c199071ef02045e9aa5e06be0a1f0f04', 'request_id': 'req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.214163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c199071ef02045e9aa5e06be0a1f0f04', 'request_id': 'req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.225526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] The token cache is being invalidate because project c199071ef02045e9aa5e06be0a1f0f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:15.225812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.226728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.228553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1310/2648] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:15 2022] DELETE /identity/v3/projects/c199071ef02045e9aa5e06be0a1f0f04 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:15.232782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42676-f273-4bf2-ae12-565d3345e688 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:15.243584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42676-f273-4bf2-ae12-565d3345e688 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:15.285192 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:15.304202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:15.305144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:15.305426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:15.305743 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] PATH_INFO: `/v3/users/88fb0bd476f44467be9ffe6cf68aef4b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:15.306954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fb0bd476f44467be9ffe6cf68aef4b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:15.308890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:15.360083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fb0bd476f44467be9ffe6cf68aef4b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.367478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fb0bd476f44467be9ffe6cf68aef4b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.368104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fb0bd476f44467be9ffe6cf68aef4b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.375638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fb0bd476f44467be9ffe6cf68aef4b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.388404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-8f43873c-1f91-4a43-9b05-ff3f52113a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fb0bd476f44467be9ffe6cf68aef4b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.394812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1339/2649] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:15 2022] DELETE /identity/v3/users/88fb0bd476f44467be9ffe6cf68aef4b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:50:15.682594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:15.684119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:15.704285 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c0bf5-441c-4df5-9f7f-a309c66d61d5 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:15.770565 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:15.771449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:15.771728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:15.772001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] PATH_INFO: `/v3/projects/f4b0f1b8095d4555be9c1e54283dcd85` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:15.773197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b0f1b8095d4555be9c1e54283dcd85)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:15.775194 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:15.826502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b0f1b8095d4555be9c1e54283dcd85', 'request_id': 'req-8c87832c-d6f8-4f1a-867d-b06795cb9632'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.835617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b0f1b8095d4555be9c1e54283dcd85', 'request_id': 'req-8c87832c-d6f8-4f1a-867d-b06795cb9632'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.841476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b0f1b8095d4555be9c1e54283dcd85', 'request_id': 'req-8c87832c-d6f8-4f1a-867d-b06795cb9632'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.852818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] The token cache is being invalidate because project f4b0f1b8095d4555be9c1e54283dcd85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:15.853140 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.853929 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-8c87832c-d6f8-4f1a-867d-b06795cb9632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:15.855521 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1311/2650] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:15 2022] DELETE /identity/v3/projects/f4b0f1b8095d4555be9c1e54283dcd85 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:15.861609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c5fb-9755-41ab-bcd0-bc06f609100d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:15.862105 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c5fb-9755-41ab-bcd0-bc06f609100d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:15.862219 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c5fb-9755-41ab-bcd0-bc06f609100d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:15.888028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e734c5fb-9755-41ab-bcd0-bc06f609100d None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:15.889215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e734c5fb-9755-41ab-bcd0-bc06f609100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:15.950231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1340/2651] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:15.958133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435200a-5334-4644-bde7-2455f5f04ea6 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:15.958532 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435200a-5334-4644-bde7-2455f5f04ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:15.958884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435200a-5334-4644-bde7-2455f5f04ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:15.978582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-f435200a-5334-4644-bde7-2455f5f04ea6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:15.980186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f435200a-5334-4644-bde7-2455f5f04ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:15.990889 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1312/2652] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:15.995498 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c5fb-9755-41ab-bcd0-bc06f609100d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.005139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c5fb-9755-41ab-bcd0-bc06f609100d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.009917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.010613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.010894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.011186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.011902 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:50:16.012212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.014030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.027389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1341/2653] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:50:16.031964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435200a-5334-4644-bde7-2455f5f04ea6 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.041517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435200a-5334-4644-bde7-2455f5f04ea6 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.047428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1b4d7-5b3c-4880-8111-dfe18bec2bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.048429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1b4d7-5b3c-4880-8111-dfe18bec2bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.048719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1b4d7-5b3c-4880-8111-dfe18bec2bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.048998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b1b4d7-5b3c-4880-8111-dfe18bec2bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.050446 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1b4d7-5b3c-4880-8111-dfe18bec2bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.052562 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b1b4d7-5b3c-4880-8111-dfe18bec2bb9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.081711 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1313/2654] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:16 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:50:16.086313 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.097765 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30fac7-08c0-4ce7-be9c-291e4bec8143 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.151045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:16.166936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1117ed-e59c-49f3-87e2-d7e950ab7e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.167629 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1117ed-e59c-49f3-87e2-d7e950ab7e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.167930 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1117ed-e59c-49f3-87e2-d7e950ab7e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.168214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1117ed-e59c-49f3-87e2-d7e950ab7e57 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.168952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1117ed-e59c-49f3-87e2-d7e950ab7e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.170980 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1117ed-e59c-49f3-87e2-d7e950ab7e57 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.194982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1342/2655] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:16 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:16.196291 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1b4d7-5b3c-4880-8111-dfe18bec2bb9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.207020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b1b4d7-5b3c-4880-8111-dfe18bec2bb9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.211976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8dda5-87d0-4b95-8b50-745379af03fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.212642 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8dda5-87d0-4b95-8b50-745379af03fc admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.212926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8dda5-87d0-4b95-8b50-745379af03fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.213205 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8dda5-87d0-4b95-8b50-745379af03fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.213939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8dda5-87d0-4b95-8b50-745379af03fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.215580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8dda5-87d0-4b95-8b50-745379af03fc admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.226055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1314/2656] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:50:16.230308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1117ed-e59c-49f3-87e2-d7e950ab7e57 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.240407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1117ed-e59c-49f3-87e2-d7e950ab7e57 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.245205 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02381e0-a1f2-4091-b053-56f94197ed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.245873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02381e0-a1f2-4091-b053-56f94197ed7b admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.246193 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02381e0-a1f2-4091-b053-56f94197ed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.246499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02381e0-a1f2-4091-b053-56f94197ed7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.247241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02381e0-a1f2-4091-b053-56f94197ed7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.248846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02381e0-a1f2-4091-b053-56f94197ed7b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.259619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1343/2657] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:16.264058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8dda5-87d0-4b95-8b50-745379af03fc admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.274615 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8dda5-87d0-4b95-8b50-745379af03fc admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.280000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea7deb-1f1e-4428-ba07-ad048f1c88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.281782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea7deb-1f1e-4428-ba07-ad048f1c88bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.282109 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea7deb-1f1e-4428-ba07-ad048f1c88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.282392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea7deb-1f1e-4428-ba07-ad048f1c88bc admin admin] PATH_INFO: `/v3/projects/55beef56c8454a7d990c4daab0ffafbd/users/7ed66f2b756d4a08854d018ed9222b0f/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.300670 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea7deb-1f1e-4428-ba07-ad048f1c88bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=55beef56c8454a7d990c4daab0ffafbd, user_id=7ed66f2b756d4a08854d018ed9222b0f, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.303471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea7deb-1f1e-4428-ba07-ad048f1c88bc admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.318801 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1315/2658] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:16 2022] PUT /identity/v3/projects/55beef56c8454a7d990c4daab0ffafbd/users/7ed66f2b756d4a08854d018ed9222b0f/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:16.329095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66903f0-822a-4e43-a491-d0d36840d5d2 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.329386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66903f0-822a-4e43-a491-d0d36840d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.329669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66903f0-822a-4e43-a491-d0d36840d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.356355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e66903f0-822a-4e43-a491-d0d36840d5d2 None None] MFA Rules not processed for user `7ed66f2b756d4a08854d018ed9222b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:16.357616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e66903f0-822a-4e43-a491-d0d36840d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:16.429293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1344/2659] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:16.433927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea7deb-1f1e-4428-ba07-ad048f1c88bc admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.440111 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:16.497653 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea7deb-1f1e-4428-ba07-ad048f1c88bc admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.502600 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ea8b-44ff-4808-bbdd-4f846984c12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.503258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ea8b-44ff-4808-bbdd-4f846984c12f admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.503540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ea8b-44ff-4808-bbdd-4f846984c12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.503815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ea8b-44ff-4808-bbdd-4f846984c12f admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.504505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795ea8b-44ff-4808-bbdd-4f846984c12f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.506477 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795ea8b-44ff-4808-bbdd-4f846984c12f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.534910 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1316/2660] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:16 2022] POST /identity/v3/projects => generated 395 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:16.540426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66903f0-822a-4e43-a491-d0d36840d5d2 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.551916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66903f0-822a-4e43-a491-d0d36840d5d2 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.616188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc47e-33cc-4c48-81af-a9ad74d324f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.616865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc47e-33cc-4c48-81af-a9ad74d324f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.617151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc47e-33cc-4c48-81af-a9ad74d324f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.617432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cc47e-33cc-4c48-81af-a9ad74d324f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.618171 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cc47e-33cc-4c48-81af-a9ad74d324f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.620145 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cc47e-33cc-4c48-81af-a9ad74d324f8 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.647676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1345/2661] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:16 2022] POST /identity/v3/users => generated 304 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:16.653836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ea8b-44ff-4808-bbdd-4f846984c12f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.668576 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ea8b-44ff-4808-bbdd-4f846984c12f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.673443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9d13-3f79-4299-913a-54a9ea6a71ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.674119 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9d13-3f79-4299-913a-54a9ea6a71ef admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.674417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9d13-3f79-4299-913a-54a9ea6a71ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.674686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9d13-3f79-4299-913a-54a9ea6a71ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.675405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d9d13-3f79-4299-913a-54a9ea6a71ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.677027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d9d13-3f79-4299-913a-54a9ea6a71ef admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.689333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1317/2662] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:16.694673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc47e-33cc-4c48-81af-a9ad74d324f8 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.711535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cc47e-33cc-4c48-81af-a9ad74d324f8 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.717130 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9c807-5566-429c-b7e0-32bc82ed2f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.718092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9c807-5566-429c-b7e0-32bc82ed2f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.718372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9c807-5566-429c-b7e0-32bc82ed2f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.718659 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9c807-5566-429c-b7e0-32bc82ed2f99 admin admin] PATH_INFO: `/v3/projects/b41ed4464e53469b9a839ac51519d5e0/users/44d0dc6d5e9a4ec391e327fccdee1ba8/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.734217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9c807-5566-429c-b7e0-32bc82ed2f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41ed4464e53469b9a839ac51519d5e0, user_id=44d0dc6d5e9a4ec391e327fccdee1ba8, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.736880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9c807-5566-429c-b7e0-32bc82ed2f99 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.753100 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1346/2663] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:16 2022] PUT /identity/v3/projects/b41ed4464e53469b9a839ac51519d5e0/users/44d0dc6d5e9a4ec391e327fccdee1ba8/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:16.757099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9d13-3f79-4299-913a-54a9ea6a71ef admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.766998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9d13-3f79-4299-913a-54a9ea6a71ef admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.829937 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e910dc-63ad-430c-b8e6-cfe0f91c01ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.830657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e910dc-63ad-430c-b8e6-cfe0f91c01ab admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.830978 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e910dc-63ad-430c-b8e6-cfe0f91c01ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.831289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e910dc-63ad-430c-b8e6-cfe0f91c01ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.832077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e910dc-63ad-430c-b8e6-cfe0f91c01ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.833825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e910dc-63ad-430c-b8e6-cfe0f91c01ab admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.844447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1318/2664] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:16.849042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9c807-5566-429c-b7e0-32bc82ed2f99 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:16.859569 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9c807-5566-429c-b7e0-32bc82ed2f99 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:16.864294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:16.865179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.865455 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.865726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] PATH_INFO: `/v3/projects/b41ed4464e53469b9a839ac51519d5e0/users/44d0dc6d5e9a4ec391e327fccdee1ba8/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.867816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41ed4464e53469b9a839ac51519d5e0, user_id=44d0dc6d5e9a4ec391e327fccdee1ba8, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:16.870551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:16.881317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1347/2665] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:16 2022] PUT /identity/v3/projects/b41ed4464e53469b9a839ac51519d5e0/users/44d0dc6d5e9a4ec391e327fccdee1ba8/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:16.892289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aae56-6c19-4ad4-9729-f691a369fe95 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:16.892584 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aae56-6c19-4ad4-9729-f691a369fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:16.892862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aae56-6c19-4ad4-9729-f691a369fe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:16.922186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-717aae56-6c19-4ad4-9729-f691a369fe95 None None] MFA Rules not processed for user `44d0dc6d5e9a4ec391e327fccdee1ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:16.923412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-717aae56-6c19-4ad4-9729-f691a369fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:16.995520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:17.002033 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1319/2666] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:17.010844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:17.012728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:17.024163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:17.079664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff04df2-2c86-40eb-b615-56f8dbc6aec4 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:17.084406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1205de-8454-42fa-9287-b36f419e898f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:17.085065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1205de-8454-42fa-9287-b36f419e898f service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:17.085349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1205de-8454-42fa-9287-b36f419e898f service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:17.085622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1205de-8454-42fa-9287-b36f419e898f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:17.095840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1205de-8454-42fa-9287-b36f419e898f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:17.097466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1205de-8454-42fa-9287-b36f419e898f service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:17.107170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1348/2667] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:17.182235 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aae56-6c19-4ad4-9729-f691a369fe95 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:17.193009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aae56-6c19-4ad4-9729-f691a369fe95 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:17.198078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ef2d2-d9bd-44b3-854e-98289934fd61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:17.198695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ef2d2-d9bd-44b3-854e-98289934fd61 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:17.198863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ef2d2-d9bd-44b3-854e-98289934fd61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:17.199144 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ef2d2-d9bd-44b3-854e-98289934fd61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:17.257871 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ef2d2-d9bd-44b3-854e-98289934fd61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:17.259449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ef2d2-d9bd-44b3-854e-98289934fd61 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:17.269164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1320/2668] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:24.591938 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1205de-8454-42fa-9287-b36f419e898f service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:24.672148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1205de-8454-42fa-9287-b36f419e898f service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:24.677740 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:24.678167 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:24.678449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:24.678727 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] PATH_INFO: `/v3/users/7ed66f2b756d4a08854d018ed9222b0f` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:24.680151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed66f2b756d4a08854d018ed9222b0f)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:24.682891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:24.735562 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed66f2b756d4a08854d018ed9222b0f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:24.744712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed66f2b756d4a08854d018ed9222b0f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:24.745388 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed66f2b756d4a08854d018ed9222b0f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:24.753333 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed66f2b756d4a08854d018ed9222b0f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:24.769869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed66f2b756d4a08854d018ed9222b0f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:24.780142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1349/2669] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:24 2022] DELETE /identity/v3/users/7ed66f2b756d4a08854d018ed9222b0f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:24.786921 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a310-1252-4bc0-a0c0-5ed8b31069cc None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:24.787492 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a310-1252-4bc0-a0c0-5ed8b31069cc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:24.787828 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839a310-1252-4bc0-a0c0-5ed8b31069cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:24.806867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-c839a310-1252-4bc0-a0c0-5ed8b31069cc None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:24.808090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c839a310-1252-4bc0-a0c0-5ed8b31069cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:24.885632 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1321/2670] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:24.896085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:24.897786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:24.935791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:24.961884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f57a19-7527-4b84-b784-7a5515a58649 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:24.965863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a70286-4fb5-4098-83b8-e326e3eca7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:24.966550 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a70286-4fb5-4098-83b8-e326e3eca7ef service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:24.966838 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a70286-4fb5-4098-83b8-e326e3eca7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:24.967120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a70286-4fb5-4098-83b8-e326e3eca7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:24.980908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a70286-4fb5-4098-83b8-e326e3eca7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:24.982711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a70286-4fb5-4098-83b8-e326e3eca7ef service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:24.993199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1350/2671] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:25.302280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a310-1252-4bc0-a0c0-5ed8b31069cc None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:25.303782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c839a310-1252-4bc0-a0c0-5ed8b31069cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:25.317420 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839a310-1252-4bc0-a0c0-5ed8b31069cc None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:25.325100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:25.326088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:25.326372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:25.326657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] PATH_INFO: `/v3/projects/55beef56c8454a7d990c4daab0ffafbd` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:25.327980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55beef56c8454a7d990c4daab0ffafbd)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:25.330006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:25.385777 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55beef56c8454a7d990c4daab0ffafbd', 'request_id': 'req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.394594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55beef56c8454a7d990c4daab0ffafbd', 'request_id': 'req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.400450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55beef56c8454a7d990c4daab0ffafbd', 'request_id': 'req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.415734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] The token cache is being invalidate because project 55beef56c8454a7d990c4daab0ffafbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:25.415947 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.416630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.418323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1322/2672] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:25 2022] DELETE /identity/v3/projects/55beef56c8454a7d990c4daab0ffafbd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:25.423639 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a70286-4fb5-4098-83b8-e326e3eca7ef service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:25.434101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a70286-4fb5-4098-83b8-e326e3eca7ef service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:25.493738 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:25.494690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:25.494976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:25.495258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] PATH_INFO: `/v3/users/44d0dc6d5e9a4ec391e327fccdee1ba8` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:25.496546 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d0dc6d5e9a4ec391e327fccdee1ba8)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:25.498554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:25.564854 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d0dc6d5e9a4ec391e327fccdee1ba8'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.574563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d0dc6d5e9a4ec391e327fccdee1ba8'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.575295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d0dc6d5e9a4ec391e327fccdee1ba8'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.583995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d0dc6d5e9a4ec391e327fccdee1ba8'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.598589 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a6565776-1433-4000-ad05-6955be3caa75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d0dc6d5e9a4ec391e327fccdee1ba8'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:25.606011 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1351/2673] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:25 2022] DELETE /identity/v3/users/44d0dc6d5e9a4ec391e327fccdee1ba8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:25.941234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:25.943736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:25.967675 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d601da-fc2c-44c8-87bc-83abfcf7ab9a admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:25.990211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:26.034338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:26.035342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.035621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.035895 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] PATH_INFO: `/v3/projects/b41ed4464e53469b9a839ac51519d5e0` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.037087 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41ed4464e53469b9a839ac51519d5e0)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:26.039103 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:26.098890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41ed4464e53469b9a839ac51519d5e0', 'request_id': 'req-6fa862b6-8d23-45ef-a54c-f7f36de61787'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:26.108047 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41ed4464e53469b9a839ac51519d5e0', 'request_id': 'req-6fa862b6-8d23-45ef-a54c-f7f36de61787'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:26.114601 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41ed4464e53469b9a839ac51519d5e0', 'request_id': 'req-6fa862b6-8d23-45ef-a54c-f7f36de61787'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:26.128342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] The token cache is being invalidate because project b41ed4464e53469b9a839ac51519d5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:26.128618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:26.129376 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6fa862b6-8d23-45ef-a54c-f7f36de61787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:26.131107 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1323/2674] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:25 2022] DELETE /identity/v3/projects/b41ed4464e53469b9a839ac51519d5e0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:26.136578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757b245-0273-401c-a68a-17d17287203f None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.136868 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757b245-0273-401c-a68a-17d17287203f None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.137173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757b245-0273-401c-a68a-17d17287203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.157932 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1757b245-0273-401c-a68a-17d17287203f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:26.159774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1757b245-0273-401c-a68a-17d17287203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:26.218668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:26.244844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1352/2675] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:26.246621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690524ad-764b-4626-b03b-472c52b3d255 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.246918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690524ad-764b-4626-b03b-472c52b3d255 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.247191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690524ad-764b-4626-b03b-472c52b3d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.267790 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-690524ad-764b-4626-b03b-472c52b3d255 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:26.269050 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-690524ad-764b-4626-b03b-472c52b3d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:26.279342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1324/2676] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:26.284652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757b245-0273-401c-a68a-17d17287203f None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:26.301969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757b245-0273-401c-a68a-17d17287203f None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:26.308787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:26.309485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.309761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.310059 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.310818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:50:26.311132 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:26.312771 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:26.327730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1353/2677] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:50:26.337505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690524ad-764b-4626-b03b-472c52b3d255 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:26.348445 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690524ad-764b-4626-b03b-472c52b3d255 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:26.353342 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd3e14-1fa6-4985-9008-d067fee53749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:26.354029 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd3e14-1fa6-4985-9008-d067fee53749 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.354314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd3e14-1fa6-4985-9008-d067fee53749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.354613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd3e14-1fa6-4985-9008-d067fee53749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.355322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd3e14-1fa6-4985-9008-d067fee53749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:26.357288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd3e14-1fa6-4985-9008-d067fee53749 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:26.388373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1325/2678] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:26 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:26.393036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:26.405216 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46c61f-1ddd-4088-95cf-3a286108b224 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:26.469746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3acda-9515-4607-935c-46c5b3a98236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:26.470500 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3acda-9515-4607-935c-46c5b3a98236 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.470792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3acda-9515-4607-935c-46c5b3a98236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.471053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3acda-9515-4607-935c-46c5b3a98236 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.471828 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3acda-9515-4607-935c-46c5b3a98236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:26.473827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3acda-9515-4607-935c-46c5b3a98236 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:26.498058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1354/2679] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:26 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:26.503279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd3e14-1fa6-4985-9008-d067fee53749 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:26.516043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd3e14-1fa6-4985-9008-d067fee53749 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:26.522288 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a97937-ff8f-4d27-bea1-a7508743d63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:26.523042 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97937-ff8f-4d27-bea1-a7508743d63c admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.523394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97937-ff8f-4d27-bea1-a7508743d63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.523728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a97937-ff8f-4d27-bea1-a7508743d63c admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.524468 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a97937-ff8f-4d27-bea1-a7508743d63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:26.526116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a97937-ff8f-4d27-bea1-a7508743d63c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:26.537723 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1326/2680] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:26.542384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3acda-9515-4607-935c-46c5b3a98236 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:26.553767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3acda-9515-4607-935c-46c5b3a98236 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:26.559142 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa93904-92ff-4d52-b13a-3136fcca7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:26.559873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa93904-92ff-4d52-b13a-3136fcca7d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.560152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa93904-92ff-4d52-b13a-3136fcca7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.560423 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa93904-92ff-4d52-b13a-3136fcca7d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.561174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa93904-92ff-4d52-b13a-3136fcca7d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:26.562912 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa93904-92ff-4d52-b13a-3136fcca7d42 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:26.574199 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1355/2681] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:26.579187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a97937-ff8f-4d27-bea1-a7508743d63c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:26.589495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a97937-ff8f-4d27-bea1-a7508743d63c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:26.594524 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:26.595463 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.595745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.596017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] PATH_INFO: `/v3/projects/8d89e60dbc6b43ed80cb70b23df562af/users/c995e3e055464e50b25c0c3961b4b2dd/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.610800 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d89e60dbc6b43ed80cb70b23df562af, user_id=c995e3e055464e50b25c0c3961b4b2dd, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:26.613495 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:26.628770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1327/2682] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:26 2022] PUT /identity/v3/projects/8d89e60dbc6b43ed80cb70b23df562af/users/c995e3e055464e50b25c0c3961b4b2dd/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:26.634058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e054b-ed91-48d4-9857-467f7b5ff2bd None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.634575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e054b-ed91-48d4-9857-467f7b5ff2bd None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.634575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e054b-ed91-48d4-9857-467f7b5ff2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.653064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-5e2e054b-ed91-48d4-9857-467f7b5ff2bd None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:26.654319 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5e2e054b-ed91-48d4-9857-467f7b5ff2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:26.716590 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1356/2683] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:26.727044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:26.729791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:26.792749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:26.797769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dacd35-198d-49b7-ab08-d71a50296919 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:26.802903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42dab-db09-429e-b24f-8a9c2208c5cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:26.803567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42dab-db09-429e-b24f-8a9c2208c5cb service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:26.803854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42dab-db09-429e-b24f-8a9c2208c5cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:26.804136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42dab-db09-429e-b24f-8a9c2208c5cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:26.814421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b42dab-db09-429e-b24f-8a9c2208c5cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:26.815943 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b42dab-db09-429e-b24f-8a9c2208c5cb service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:26.826643 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1328/2684] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:27.492983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c53cd-5497-427d-85ec-8dbe2bc218e5 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:27.493181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c53cd-5497-427d-85ec-8dbe2bc218e5 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:27.493470 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c53cd-5497-427d-85ec-8dbe2bc218e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:27.522852 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-149c53cd-5497-427d-85ec-8dbe2bc218e5 None None] MFA Rules not processed for user `c995e3e055464e50b25c0c3961b4b2dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:27.524112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-149c53cd-5497-427d-85ec-8dbe2bc218e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:27.582170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:27.608174 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1357/2685] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:27.613220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42dab-db09-429e-b24f-8a9c2208c5cb service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:27.623893 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42dab-db09-429e-b24f-8a9c2208c5cb service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:27.629014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c678d88-cdfa-4d21-97fb-03ad95e04e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:27.629695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678d88-cdfa-4d21-97fb-03ad95e04e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:27.630017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678d88-cdfa-4d21-97fb-03ad95e04e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:27.630305 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678d88-cdfa-4d21-97fb-03ad95e04e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:27.631009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c678d88-cdfa-4d21-97fb-03ad95e04e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:27.632982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c678d88-cdfa-4d21-97fb-03ad95e04e9e admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:27.666231 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1329/2686] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:50:27 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:27.667391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c53cd-5497-427d-85ec-8dbe2bc218e5 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:27.679094 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c53cd-5497-427d-85ec-8dbe2bc218e5 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:27.736720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553b50-4917-4cc8-a9cb-a0234c01867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:27.737515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553b50-4917-4cc8-a9cb-a0234c01867d admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:27.737801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553b50-4917-4cc8-a9cb-a0234c01867d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:27.738231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553b50-4917-4cc8-a9cb-a0234c01867d admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:27.738948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5553b50-4917-4cc8-a9cb-a0234c01867d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:27.740891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5553b50-4917-4cc8-a9cb-a0234c01867d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:27.763217 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1358/2687] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:50:27 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:50:27.767426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c678d88-cdfa-4d21-97fb-03ad95e04e9e admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:27.779476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c678d88-cdfa-4d21-97fb-03ad95e04e9e admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:27.784613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9cead-c9f1-402a-acc1-ea20f1ecf9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:27.785294 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9cead-c9f1-402a-acc1-ea20f1ecf9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:27.785581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9cead-c9f1-402a-acc1-ea20f1ecf9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:27.785861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9cead-c9f1-402a-acc1-ea20f1ecf9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:27.786625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9cead-c9f1-402a-acc1-ea20f1ecf9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:27.788507 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9cead-c9f1-402a-acc1-ea20f1ecf9ef admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:27.800187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1330/2688] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:50:27.804744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553b50-4917-4cc8-a9cb-a0234c01867d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:27.814849 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553b50-4917-4cc8-a9cb-a0234c01867d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:27.820846 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732da2f-021b-45b2-a612-424f233361c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:27.821801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732da2f-021b-45b2-a612-424f233361c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:27.822126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732da2f-021b-45b2-a612-424f233361c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:27.822409 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732da2f-021b-45b2-a612-424f233361c9 admin admin] PATH_INFO: `/v3/projects/8a27378f13ad41328db62a7896b9b3da/users/2f91ba4af9fd4ffc80f10ad09fe50b08/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:27.838312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732da2f-021b-45b2-a612-424f233361c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a27378f13ad41328db62a7896b9b3da, user_id=2f91ba4af9fd4ffc80f10ad09fe50b08, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:27.840991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732da2f-021b-45b2-a612-424f233361c9 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:27.855453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1359/2689] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:27 2022] PUT /identity/v3/projects/8a27378f13ad41328db62a7896b9b3da/users/2f91ba4af9fd4ffc80f10ad09fe50b08/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:50:27.859757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9cead-c9f1-402a-acc1-ea20f1ecf9ef admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:27.870338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9cead-c9f1-402a-acc1-ea20f1ecf9ef admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:27.928545 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ea60e-02d5-4045-8380-f2664eb442ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:27.929221 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea60e-02d5-4045-8380-f2664eb442ed admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:27.929499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea60e-02d5-4045-8380-f2664eb442ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:27.929773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea60e-02d5-4045-8380-f2664eb442ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:27.930530 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ea60e-02d5-4045-8380-f2664eb442ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:27.932131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ea60e-02d5-4045-8380-f2664eb442ed admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:27.942992 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1331/2690] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:50:27.947277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732da2f-021b-45b2-a612-424f233361c9 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:27.957966 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732da2f-021b-45b2-a612-424f233361c9 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:27.962890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:27.963774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:27.964057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:27.964342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] PATH_INFO: `/v3/projects/8a27378f13ad41328db62a7896b9b3da/users/2f91ba4af9fd4ffc80f10ad09fe50b08/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:27.966424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a27378f13ad41328db62a7896b9b3da, user_id=2f91ba4af9fd4ffc80f10ad09fe50b08, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:27.969085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:27.982467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1360/2691] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:50:27 2022] PUT /identity/v3/projects/8a27378f13ad41328db62a7896b9b3da/users/2f91ba4af9fd4ffc80f10ad09fe50b08/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:28.693130 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d9b16-52a9-4fc2-af2e-9bdc92919901 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:28.694769 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d9b16-52a9-4fc2-af2e-9bdc92919901 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:28.695230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d9b16-52a9-4fc2-af2e-9bdc92919901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:28.735135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d64d9b16-52a9-4fc2-af2e-9bdc92919901 None None] MFA Rules not processed for user `2f91ba4af9fd4ffc80f10ad09fe50b08`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:28.736770 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d64d9b16-52a9-4fc2-af2e-9bdc92919901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:28.810483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1332/2692] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:28.822596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:28.824607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:28.885913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c84a10-1dcb-4707-8bc4-121562f54b87 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:28.889787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2135-1d32-4a82-ab62-0ad60a2c6328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:28.890475 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2135-1d32-4a82-ab62-0ad60a2c6328 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:28.890757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2135-1d32-4a82-ab62-0ad60a2c6328 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:28.891144 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad2135-1d32-4a82-ab62-0ad60a2c6328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:28.945456 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:28.947782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad2135-1d32-4a82-ab62-0ad60a2c6328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:28.949322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad2135-1d32-4a82-ab62-0ad60a2c6328 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:28.959797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1361/2693] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:30.376915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d9b16-52a9-4fc2-af2e-9bdc92919901 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:30.390200 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d9b16-52a9-4fc2-af2e-9bdc92919901 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:30.394272 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277129f-80c5-43aa-a714-08811c585bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:30.394914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277129f-80c5-43aa-a714-08811c585bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:30.395196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277129f-80c5-43aa-a714-08811c585bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:30.395471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277129f-80c5-43aa-a714-08811c585bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:30.404683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277129f-80c5-43aa-a714-08811c585bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:30.406137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277129f-80c5-43aa-a714-08811c585bd5 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:30.415454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1333/2694] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:50:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:50:38.960936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:40.411635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:58.510306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2135-1d32-4a82-ab62-0ad60a2c6328 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:58.578401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad2135-1d32-4a82-ab62-0ad60a2c6328 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:58.583598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:58.584486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:58.584769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:58.585042 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] PATH_INFO: `/v3/users/c995e3e055464e50b25c0c3961b4b2dd` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:58.586372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c995e3e055464e50b25c0c3961b4b2dd)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:58.588368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:58.636780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c995e3e055464e50b25c0c3961b4b2dd'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.645306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c995e3e055464e50b25c0c3961b4b2dd'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.645910 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c995e3e055464e50b25c0c3961b4b2dd'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.652668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c995e3e055464e50b25c0c3961b4b2dd'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.665258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c995e3e055464e50b25c0c3961b4b2dd'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.671482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1362/2695] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:58 2022] DELETE /identity/v3/users/c995e3e055464e50b25c0c3961b4b2dd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:58.850738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277129f-80c5-43aa-a714-08811c585bd5 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:58.862190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277129f-80c5-43aa-a714-08811c585bd5 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:58.918448 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:58.919249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:58.919527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:58.919794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] PATH_INFO: `/v3/projects/8d89e60dbc6b43ed80cb70b23df562af` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:58.920973 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d89e60dbc6b43ed80cb70b23df562af)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:58.922920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:58.971418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d89e60dbc6b43ed80cb70b23df562af', 'request_id': 'req-5b9cbbe8-2f34-4586-8989-6db32beea55d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.980505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d89e60dbc6b43ed80cb70b23df562af', 'request_id': 'req-5b9cbbe8-2f34-4586-8989-6db32beea55d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.986394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d89e60dbc6b43ed80cb70b23df562af', 'request_id': 'req-5b9cbbe8-2f34-4586-8989-6db32beea55d'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.998037 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] The token cache is being invalidate because project 8d89e60dbc6b43ed80cb70b23df562af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:58.998330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:58.999053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.000708 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1334/2696] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:58 2022] DELETE /identity/v3/projects/8d89e60dbc6b43ed80cb70b23df562af => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:50:59.005170 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:59.006673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:59.031161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883eebb7-bd26-4cb7-b8da-6338dc4b01db admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:59.089808 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:59.090730 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:59.091019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:59.091305 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] PATH_INFO: `/v3/users/2f91ba4af9fd4ffc80f10ad09fe50b08` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:59.092644 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f91ba4af9fd4ffc80f10ad09fe50b08)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:59.094748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:59.110747 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:59.164841 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f91ba4af9fd4ffc80f10ad09fe50b08'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.173789 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f91ba4af9fd4ffc80f10ad09fe50b08'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.174360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f91ba4af9fd4ffc80f10ad09fe50b08'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.185746 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f91ba4af9fd4ffc80f10ad09fe50b08'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.201122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6ccce74e-f2a7-4591-b102-ff8078f10fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f91ba4af9fd4ffc80f10ad09fe50b08'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.207452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1363/2697] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:50:59 2022] DELETE /identity/v3/users/2f91ba4af9fd4ffc80f10ad09fe50b08 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:59.656010 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:59.657656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:59.672062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9cbbe8-2f34-4586-8989-6db32beea55d admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:59.729673 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:59.730624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:59.730840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:59.731097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] PATH_INFO: `/v3/projects/8a27378f13ad41328db62a7896b9b3da` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:59.732262 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a27378f13ad41328db62a7896b9b3da)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:59.734413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:59.770564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:59.786192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a27378f13ad41328db62a7896b9b3da', 'request_id': 'req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.794812 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a27378f13ad41328db62a7896b9b3da', 'request_id': 'req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.800397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a27378f13ad41328db62a7896b9b3da', 'request_id': 'req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.811467 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] The token cache is being invalidate because project 8a27378f13ad41328db62a7896b9b3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:50:59.811747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.812434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6d1acd14-ada8-486e-b7da-a1ae2c04f8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:50:59.814286 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1335/2698] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:50:59 2022] DELETE /identity/v3/projects/8a27378f13ad41328db62a7896b9b3da => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:50:59.823158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4931a7-0e59-44f6-aa58-ae00dd84429a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:59.823736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4931a7-0e59-44f6-aa58-ae00dd84429a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:59.823736 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4931a7-0e59-44f6-aa58-ae00dd84429a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:59.845900 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-7e4931a7-0e59-44f6-aa58-ae00dd84429a None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:59.847158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-7e4931a7-0e59-44f6-aa58-ae00dd84429a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:59.917614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1364/2699] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:59.928738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580c2d1-f071-4ff7-9c6f-d69bb50a9465 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:59.929627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580c2d1-f071-4ff7-9c6f-d69bb50a9465 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:59.929899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580c2d1-f071-4ff7-9c6f-d69bb50a9465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:59.950431 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d580c2d1-f071-4ff7-9c6f-d69bb50a9465 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:50:59.951784 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d580c2d1-f071-4ff7-9c6f-d69bb50a9465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:50:59.959864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1336/2700] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:50:59.964176 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4931a7-0e59-44f6-aa58-ae00dd84429a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:50:59.974099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4931a7-0e59-44f6-aa58-ae00dd84429a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:50:59.979552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:50:59.980479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:50:59.980881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:50:59.981148 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:50:59.981934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:50:59.982275 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:50:59.984058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:50:59.996433 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1365/2701] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:51:00.001177 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580c2d1-f071-4ff7-9c6f-d69bb50a9465 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:00.011290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580c2d1-f071-4ff7-9c6f-d69bb50a9465 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:00.016972 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a919-98e0-49fe-b018-b3175cd09095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:00.017619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a919-98e0-49fe-b018-b3175cd09095 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:00.017901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a919-98e0-49fe-b018-b3175cd09095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:00.018217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54a919-98e0-49fe-b018-b3175cd09095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:00.018915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54a919-98e0-49fe-b018-b3175cd09095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:00.020848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54a919-98e0-49fe-b018-b3175cd09095 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:00.048266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1337/2702] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:00 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:00.052531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:00.063037 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84c05-a7bc-4163-b6b9-be5a69943dbe admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:00.121714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e72a-d8c6-4f5a-9131-539322f06de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:00.122452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e72a-d8c6-4f5a-9131-539322f06de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:00.122744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e72a-d8c6-4f5a-9131-539322f06de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:00.123026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41e72a-d8c6-4f5a-9131-539322f06de7 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:00.123753 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e72a-d8c6-4f5a-9131-539322f06de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:00.125744 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41e72a-d8c6-4f5a-9131-539322f06de7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:00.148006 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1366/2703] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:00 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:51:00.152838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a919-98e0-49fe-b018-b3175cd09095 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:00.166428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54a919-98e0-49fe-b018-b3175cd09095 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:00.171747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43bc5c-792d-49cd-bead-13d143b72274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:00.172417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43bc5c-792d-49cd-bead-13d143b72274 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:00.172701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43bc5c-792d-49cd-bead-13d143b72274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:00.172980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43bc5c-792d-49cd-bead-13d143b72274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:00.173722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43bc5c-792d-49cd-bead-13d143b72274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:00.175383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43bc5c-792d-49cd-bead-13d143b72274 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:00.185901 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1338/2704] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:00.189996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e72a-d8c6-4f5a-9131-539322f06de7 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:00.200595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41e72a-d8c6-4f5a-9131-539322f06de7 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:00.205979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374239ae-7bf8-41a7-911e-e9a76ee11c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:00.206679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374239ae-7bf8-41a7-911e-e9a76ee11c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:00.206963 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374239ae-7bf8-41a7-911e-e9a76ee11c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:00.207262 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374239ae-7bf8-41a7-911e-e9a76ee11c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:00.208002 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374239ae-7bf8-41a7-911e-e9a76ee11c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:00.209578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374239ae-7bf8-41a7-911e-e9a76ee11c48 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:00.210982 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:00.225186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1367/2705] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:00.229796 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43bc5c-792d-49cd-bead-13d143b72274 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:00.240513 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43bc5c-792d-49cd-bead-13d143b72274 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:00.245337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:00.246258 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:00.246539 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:00.246810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] PATH_INFO: `/v3/projects/579498cffbc64d79b07ba01ebbd71721/users/281d0550b11447989b3c84fb7cf3529b/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:00.265724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579498cffbc64d79b07ba01ebbd71721, user_id=281d0550b11447989b3c84fb7cf3529b, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:00.269994 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:00.286057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1339/2706] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:00 2022] PUT /identity/v3/projects/579498cffbc64d79b07ba01ebbd71721/users/281d0550b11447989b3c84fb7cf3529b/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:00.296535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c4fd8-ce90-4abf-95df-d9975c2b6038 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:00.297535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c4fd8-ce90-4abf-95df-d9975c2b6038 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:00.297787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c4fd8-ce90-4abf-95df-d9975c2b6038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:00.325693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-364c4fd8-ce90-4abf-95df-d9975c2b6038 None None] MFA Rules not processed for user `281d0550b11447989b3c84fb7cf3529b`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:00.327120 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-364c4fd8-ce90-4abf-95df-d9975c2b6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:00.397735 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1368/2707] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:00.409697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:00.411593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:00.472397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80228d22-86bb-403b-a27e-7064200ef8a3 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:00.476737 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b2b54-f701-4c9e-9fcf-ae1e58e48a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:00.477382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2b54-f701-4c9e-9fcf-ae1e58e48a13 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:00.477664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2b54-f701-4c9e-9fcf-ae1e58e48a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:00.477961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b2b54-f701-4c9e-9fcf-ae1e58e48a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:00.487844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b2b54-f701-4c9e-9fcf-ae1e58e48a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:00.489374 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b2b54-f701-4c9e-9fcf-ae1e58e48a13 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:00.498728 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1340/2708] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:10.394606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=34 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:10.494730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:21.857382 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c4fd8-ce90-4abf-95df-d9975c2b6038 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:21.858899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-364c4fd8-ce90-4abf-95df-d9975c2b6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:21.986238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c4fd8-ce90-4abf-95df-d9975c2b6038 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:21.992316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:21.993196 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:21.993482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:21.993759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] PATH_INFO: `/v3/users/8e6bd77c882840c4a91e07537bbe5b50` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:21.995073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6bd77c882840c4a91e07537bbe5b50)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:21.997322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:22.053138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6bd77c882840c4a91e07537bbe5b50'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.062355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6bd77c882840c4a91e07537bbe5b50'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.063228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6bd77c882840c4a91e07537bbe5b50'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.070454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6bd77c882840c4a91e07537bbe5b50'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.082266 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6bd77c882840c4a91e07537bbe5b50'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.088657 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1369/2709] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:21 2022] DELETE /identity/v3/users/8e6bd77c882840c4a91e07537bbe5b50 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:22.095613 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aeab9-eb63-4273-9f4c-fb154cbb2fec None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:22.096123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aeab9-eb63-4273-9f4c-fb154cbb2fec None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:22.096243 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94aeab9-eb63-4273-9f4c-fb154cbb2fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:22.128692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a94aeab9-eb63-4273-9f4c-fb154cbb2fec None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:22.129918 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a94aeab9-eb63-4273-9f4c-fb154cbb2fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:22.193096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1341/2710] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:22.203085 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:22.204741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:22.237996 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:22.301598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7483f-2529-4887-9f62-f5484db513f5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:22.305916 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478a93-4973-486b-b9c7-c1ac71e4b7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:22.306972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478a93-4973-486b-b9c7-c1ac71e4b7cd service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:22.307328 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478a93-4973-486b-b9c7-c1ac71e4b7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:22.307652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478a93-4973-486b-b9c7-c1ac71e4b7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:22.323448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06478a93-4973-486b-b9c7-c1ac71e4b7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:22.325599 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06478a93-4973-486b-b9c7-c1ac71e4b7cd service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:22.335074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1370/2711] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:22.618547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aeab9-eb63-4273-9f4c-fb154cbb2fec None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:22.620156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a94aeab9-eb63-4273-9f4c-fb154cbb2fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:22.632555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94aeab9-eb63-4273-9f4c-fb154cbb2fec None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:22.639135 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:22.640085 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:22.640278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:22.640551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] PATH_INFO: `/v3/projects/f512ea6e47284d859e225ef77eb8f28e` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:22.642486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f512ea6e47284d859e225ef77eb8f28e)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:22.644594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:22.696411 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f512ea6e47284d859e225ef77eb8f28e', 'request_id': 'req-5914f174-0af6-4c87-9af2-5e74c2f49003'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.711207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f512ea6e47284d859e225ef77eb8f28e', 'request_id': 'req-5914f174-0af6-4c87-9af2-5e74c2f49003'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.717687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f512ea6e47284d859e225ef77eb8f28e', 'request_id': 'req-5914f174-0af6-4c87-9af2-5e74c2f49003'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.728829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] The token cache is being invalidate because project f512ea6e47284d859e225ef77eb8f28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:22.729116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.729760 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.731371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1342/2712] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:22 2022] DELETE /identity/v3/projects/f512ea6e47284d859e225ef77eb8f28e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:22.736202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478a93-4973-486b-b9c7-c1ac71e4b7cd service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:22.750376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478a93-4973-486b-b9c7-c1ac71e4b7cd service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:22.816653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:22.817534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:22.817819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:22.818125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] PATH_INFO: `/v3/users/ccb958c528f949a28afc2ddf3ad9d491` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:22.819368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb958c528f949a28afc2ddf3ad9d491)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:22.821283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:22.877293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb958c528f949a28afc2ddf3ad9d491'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.887558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb958c528f949a28afc2ddf3ad9d491'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.888499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb958c528f949a28afc2ddf3ad9d491'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.895981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb958c528f949a28afc2ddf3ad9d491'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.907943 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3f6e3b76-fb5c-481b-a69e-8b265d65bb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb958c528f949a28afc2ddf3ad9d491'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:22.913978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1371/2713] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:22 2022] DELETE /identity/v3/users/ccb958c528f949a28afc2ddf3ad9d491 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:23.195383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:23.196811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:23.212280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914f174-0af6-4c87-9af2-5e74c2f49003 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:23.274398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:23.275301 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.275608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.275884 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] PATH_INFO: `/v3/projects/8defb027355c4bb9a9526641243147aa` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.277081 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8defb027355c4bb9a9526641243147aa)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:23.279092 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:23.300337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:23.331447 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8defb027355c4bb9a9526641243147aa', 'request_id': 'req-aa83c400-3cb2-4c76-8270-e1696b7ac934'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:23.342498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8defb027355c4bb9a9526641243147aa', 'request_id': 'req-aa83c400-3cb2-4c76-8270-e1696b7ac934'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:23.348864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8defb027355c4bb9a9526641243147aa', 'request_id': 'req-aa83c400-3cb2-4c76-8270-e1696b7ac934'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:23.362162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] The token cache is being invalidate because project 8defb027355c4bb9a9526641243147aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:23.362453 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:23.363120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-aa83c400-3cb2-4c76-8270-e1696b7ac934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:23.364745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1343/2714] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:23 2022] DELETE /identity/v3/projects/8defb027355c4bb9a9526641243147aa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:23.370677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700271-adcf-45fa-81b4-a7c3b7e11a95 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.370967 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700271-adcf-45fa-81b4-a7c3b7e11a95 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.371244 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c700271-adcf-45fa-81b4-a7c3b7e11a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.387631 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:23.424953 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1c700271-adcf-45fa-81b4-a7c3b7e11a95 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:23.426203 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1c700271-adcf-45fa-81b4-a7c3b7e11a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:23.488340 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1372/2715] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:23.499021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981531cd-23f5-402a-9fb0-afd2ac99d3cc None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.499307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981531cd-23f5-402a-9fb0-afd2ac99d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.499581 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981531cd-23f5-402a-9fb0-afd2ac99d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.519394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-981531cd-23f5-402a-9fb0-afd2ac99d3cc None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:23.520592 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-981531cd-23f5-402a-9fb0-afd2ac99d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:23.529626 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1344/2716] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:23.534177 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c700271-adcf-45fa-81b4-a7c3b7e11a95 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:23.545486 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c700271-adcf-45fa-81b4-a7c3b7e11a95 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:23.551345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:23.552038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.552318 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.552586 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.553338 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:51:23.553645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:23.557049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:23.570825 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1373/2717] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:51:23.575352 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981531cd-23f5-402a-9fb0-afd2ac99d3cc None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:23.585404 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981531cd-23f5-402a-9fb0-afd2ac99d3cc None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:23.591591 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9bb0-9a25-426f-b3d5-560480f37334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:23.592354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9bb0-9a25-426f-b3d5-560480f37334 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.592634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9bb0-9a25-426f-b3d5-560480f37334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.592882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc9bb0-9a25-426f-b3d5-560480f37334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.593572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc9bb0-9a25-426f-b3d5-560480f37334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:23.595514 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc9bb0-9a25-426f-b3d5-560480f37334 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:23.624721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1345/2718] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:23 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:23.628958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:23.639385 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244432f-b22a-44a8-b260-18fe9b3919e6 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:23.697263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f79c45-1575-4289-adee-53fd95085dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:23.698165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f79c45-1575-4289-adee-53fd95085dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.698454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f79c45-1575-4289-adee-53fd95085dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.698731 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f79c45-1575-4289-adee-53fd95085dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.699469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f79c45-1575-4289-adee-53fd95085dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:23.701506 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f79c45-1575-4289-adee-53fd95085dd8 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:23.726681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1374/2719] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:23 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:51:23.728193 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9bb0-9a25-426f-b3d5-560480f37334 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:23.739277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc9bb0-9a25-426f-b3d5-560480f37334 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:23.745045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5f4cc-cdf4-4d12-aaa2-7d64935fcdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:23.745705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f4cc-cdf4-4d12-aaa2-7d64935fcdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.746015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f4cc-cdf4-4d12-aaa2-7d64935fcdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.746289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f4cc-cdf4-4d12-aaa2-7d64935fcdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.747015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5f4cc-cdf4-4d12-aaa2-7d64935fcdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:23.748896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5f4cc-cdf4-4d12-aaa2-7d64935fcdf6 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:23.760226 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1346/2720] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:23.764469 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f79c45-1575-4289-adee-53fd95085dd8 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:23.774548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f79c45-1575-4289-adee-53fd95085dd8 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:23.779766 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376967b-8326-4512-97e9-db16eb7303dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:23.780323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376967b-8326-4512-97e9-db16eb7303dd admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.780601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376967b-8326-4512-97e9-db16eb7303dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.780879 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376967b-8326-4512-97e9-db16eb7303dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.781605 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376967b-8326-4512-97e9-db16eb7303dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:23.783238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376967b-8326-4512-97e9-db16eb7303dd admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:23.793276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1375/2721] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:23.797475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5f4cc-cdf4-4d12-aaa2-7d64935fcdf6 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:23.807476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5f4cc-cdf4-4d12-aaa2-7d64935fcdf6 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:23.815417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a4bb9-96a9-48cd-b713-b5972bd81885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:23.817063 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a4bb9-96a9-48cd-b713-b5972bd81885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.817421 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a4bb9-96a9-48cd-b713-b5972bd81885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.817765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a4bb9-96a9-48cd-b713-b5972bd81885 admin admin] PATH_INFO: `/v3/projects/bfb742d317d84e7e88582581a50a105b/users/5e2cc44d93d44a12abba43e3955f29a1/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.835850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a4bb9-96a9-48cd-b713-b5972bd81885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb742d317d84e7e88582581a50a105b, user_id=5e2cc44d93d44a12abba43e3955f29a1, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:23.838679 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a4bb9-96a9-48cd-b713-b5972bd81885 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:23.854184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1347/2722] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:23 2022] PUT /identity/v3/projects/bfb742d317d84e7e88582581a50a105b/users/5e2cc44d93d44a12abba43e3955f29a1/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:51:23.864974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48873a-d8cd-4a52-9f69-ea7774a58b1c None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:23.865272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48873a-d8cd-4a52-9f69-ea7774a58b1c None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:23.865558 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48873a-d8cd-4a52-9f69-ea7774a58b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:23.893792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-cf48873a-d8cd-4a52-9f69-ea7774a58b1c None None] MFA Rules not processed for user `5e2cc44d93d44a12abba43e3955f29a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:23.895066 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cf48873a-d8cd-4a52-9f69-ea7774a58b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:23.938563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:23.961157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1376/2723] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:23.965793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a4bb9-96a9-48cd-b713-b5972bd81885 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:24.029596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a4bb9-96a9-48cd-b713-b5972bd81885 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:24.036311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c920f2-e837-462e-8166-38924d014e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:24.037124 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c920f2-e837-462e-8166-38924d014e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.037480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c920f2-e837-462e-8166-38924d014e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.037836 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c920f2-e837-462e-8166-38924d014e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.038850 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c920f2-e837-462e-8166-38924d014e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:24.041795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c920f2-e837-462e-8166-38924d014e10 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:24.070654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1348/2724] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:23 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:24.074721 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48873a-d8cd-4a52-9f69-ea7774a58b1c None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:24.085310 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48873a-d8cd-4a52-9f69-ea7774a58b1c None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:24.147152 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a0aea-0d05-4a4e-96a9-5ac27268123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:24.147817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0aea-0d05-4a4e-96a9-5ac27268123a admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.148096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0aea-0d05-4a4e-96a9-5ac27268123a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.148369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a0aea-0d05-4a4e-96a9-5ac27268123a admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.149071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a0aea-0d05-4a4e-96a9-5ac27268123a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:24.151012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a0aea-0d05-4a4e-96a9-5ac27268123a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:24.173853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1377/2725] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:24 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:51:24.177778 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c920f2-e837-462e-8166-38924d014e10 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:24.188669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c920f2-e837-462e-8166-38924d014e10 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:24.193984 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225eed-8496-43a8-b96a-7ef69aa5e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:24.194659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225eed-8496-43a8-b96a-7ef69aa5e9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.194950 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225eed-8496-43a8-b96a-7ef69aa5e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.195230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc225eed-8496-43a8-b96a-7ef69aa5e9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.195964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc225eed-8496-43a8-b96a-7ef69aa5e9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:24.197586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc225eed-8496-43a8-b96a-7ef69aa5e9e0 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:24.208631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1349/2726] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:24.212606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a0aea-0d05-4a4e-96a9-5ac27268123a admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:24.223442 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a0aea-0d05-4a4e-96a9-5ac27268123a admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:24.229138 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6af6-98df-4de6-85d8-0963d1181361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:24.230326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6af6-98df-4de6-85d8-0963d1181361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.230663 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6af6-98df-4de6-85d8-0963d1181361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.231008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bd6af6-98df-4de6-85d8-0963d1181361 admin admin] PATH_INFO: `/v3/projects/64134efc911b4b4bb507a3d4ab5b37dd/users/d993cdf0a3184e3da334847b84d88810/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.246426 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd6af6-98df-4de6-85d8-0963d1181361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64134efc911b4b4bb507a3d4ab5b37dd, user_id=d993cdf0a3184e3da334847b84d88810, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:24.249871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bd6af6-98df-4de6-85d8-0963d1181361 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:24.265358 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1378/2727] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:24 2022] PUT /identity/v3/projects/64134efc911b4b4bb507a3d4ab5b37dd/users/d993cdf0a3184e3da334847b84d88810/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:24.269339 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225eed-8496-43a8-b96a-7ef69aa5e9e0 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:24.279527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc225eed-8496-43a8-b96a-7ef69aa5e9e0 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:24.292137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:24.338335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e5c0c-6191-4873-94d9-e1260cb39eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:24.339004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5c0c-6191-4873-94d9-e1260cb39eee admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.339290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5c0c-6191-4873-94d9-e1260cb39eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.339566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5c0c-6191-4873-94d9-e1260cb39eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.340302 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e5c0c-6191-4873-94d9-e1260cb39eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:24.341993 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e5c0c-6191-4873-94d9-e1260cb39eee admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:24.351946 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1350/2728] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:24.356991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6af6-98df-4de6-85d8-0963d1181361 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:24.372514 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bd6af6-98df-4de6-85d8-0963d1181361 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:24.377535 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:24.378454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.378733 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.379008 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] PATH_INFO: `/v3/projects/64134efc911b4b4bb507a3d4ab5b37dd/users/d993cdf0a3184e3da334847b84d88810/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.380969 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64134efc911b4b4bb507a3d4ab5b37dd, user_id=d993cdf0a3184e3da334847b84d88810, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:24.383626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:24.394466 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1379/2729] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:24 2022] PUT /identity/v3/projects/64134efc911b4b4bb507a3d4ab5b37dd/users/d993cdf0a3184e3da334847b84d88810/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:24.406259 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77e06-7e33-4a51-8162-db7e9265b34c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.406724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77e06-7e33-4a51-8162-db7e9265b34c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.407209 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db77e06-7e33-4a51-8162-db7e9265b34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.438473 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0db77e06-7e33-4a51-8162-db7e9265b34c None None] MFA Rules not processed for user `d993cdf0a3184e3da334847b84d88810`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:24.439683 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0db77e06-7e33-4a51-8162-db7e9265b34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:24.510413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1351/2730] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:24.524873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:24.528259 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:24.618026 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48326418-0aa5-4e7f-8623-19a1ca4a2203 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:24.622268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f8bfc-0192-4543-975e-c265b8934592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:24.623012 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f8bfc-0192-4543-975e-c265b8934592 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.623306 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f8bfc-0192-4543-975e-c265b8934592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.623582 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f8bfc-0192-4543-975e-c265b8934592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.633519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f8bfc-0192-4543-975e-c265b8934592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:24.634986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f8bfc-0192-4543-975e-c265b8934592 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:24.644714 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1380/2731] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:24.780744 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77e06-7e33-4a51-8162-db7e9265b34c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:24.855644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db77e06-7e33-4a51-8162-db7e9265b34c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:24.861534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:24.862449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.862743 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.863030 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] PATH_INFO: `/v3/users/5e2cc44d93d44a12abba43e3955f29a1` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.864357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2cc44d93d44a12abba43e3955f29a1)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:24.866335 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:24.914323 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:24.920021 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2cc44d93d44a12abba43e3955f29a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:24.920968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2cc44d93d44a12abba43e3955f29a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:24.929809 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2cc44d93d44a12abba43e3955f29a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:24.937168 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2cc44d93d44a12abba43e3955f29a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:24.949363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2cc44d93d44a12abba43e3955f29a1'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:24.955330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1352/2732] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:24 2022] DELETE /identity/v3/users/5e2cc44d93d44a12abba43e3955f29a1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:24.960104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79025b3-b8f2-46c3-bea3-0e7b80b0aba3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:24.960665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79025b3-b8f2-46c3-bea3-0e7b80b0aba3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:24.960665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79025b3-b8f2-46c3-bea3-0e7b80b0aba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:24.979039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-e79025b3-b8f2-46c3-bea3-0e7b80b0aba3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:24.980330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e79025b3-b8f2-46c3-bea3-0e7b80b0aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:24.993907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:25.041325 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1381/2733] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:25.051398 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:25.052916 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:25.112603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec90e44-4aa3-423d-8b56-0582216669b8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:25.116438 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ceb6b-992f-49ed-b163-74e0c8bd02b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:25.117088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ceb6b-992f-49ed-b163-74e0c8bd02b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:25.117370 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ceb6b-992f-49ed-b163-74e0c8bd02b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:25.117680 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ceb6b-992f-49ed-b163-74e0c8bd02b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:25.127891 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ceb6b-992f-49ed-b163-74e0c8bd02b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:25.129333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ceb6b-992f-49ed-b163-74e0c8bd02b8 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:25.139556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1353/2734] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:25.432101 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79025b3-b8f2-46c3-bea3-0e7b80b0aba3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:25.433640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e79025b3-b8f2-46c3-bea3-0e7b80b0aba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:25.446150 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79025b3-b8f2-46c3-bea3-0e7b80b0aba3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:25.451407 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:25.452499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:25.452832 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:25.453111 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] PATH_INFO: `/v3/projects/bfb742d317d84e7e88582581a50a105b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:25.455163 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb742d317d84e7e88582581a50a105b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:25.457376 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:25.507282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb742d317d84e7e88582581a50a105b', 'request_id': 'req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.516049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb742d317d84e7e88582581a50a105b', 'request_id': 'req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.521484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb742d317d84e7e88582581a50a105b', 'request_id': 'req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.534211 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] The token cache is being invalidate because project bfb742d317d84e7e88582581a50a105b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:25.534501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.535124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.536675 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1382/2735] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:25 2022] DELETE /identity/v3/projects/bfb742d317d84e7e88582581a50a105b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:51:25.540724 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ceb6b-992f-49ed-b163-74e0c8bd02b8 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:25.550648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ceb6b-992f-49ed-b163-74e0c8bd02b8 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:25.622961 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:25.623841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:25.624123 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:25.624401 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] PATH_INFO: `/v3/users/d993cdf0a3184e3da334847b84d88810` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:25.625664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d993cdf0a3184e3da334847b84d88810)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:25.627650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:25.677526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd993cdf0a3184e3da334847b84d88810'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.678202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd993cdf0a3184e3da334847b84d88810'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.687240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd993cdf0a3184e3da334847b84d88810'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.696190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd993cdf0a3184e3da334847b84d88810'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.697413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:25.711281 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-e5c00f21-05ad-4259-b3c3-ec5880ee46d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd993cdf0a3184e3da334847b84d88810'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:25.717713 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1354/2736] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:25 2022] DELETE /identity/v3/users/d993cdf0a3184e3da334847b84d88810 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:26.001794 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.003481 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:26.017482 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3137e2-e4af-4a4f-95c9-1c7cccf3aca3 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.075993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.076876 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.077162 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.077443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] PATH_INFO: `/v3/projects/64134efc911b4b4bb507a3d4ab5b37dd` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.078658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64134efc911b4b4bb507a3d4ab5b37dd)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.080592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.125179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:26.128517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64134efc911b4b4bb507a3d4ab5b37dd', 'request_id': 'req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:26.136851 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64134efc911b4b4bb507a3d4ab5b37dd', 'request_id': 'req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:26.142683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64134efc911b4b4bb507a3d4ab5b37dd', 'request_id': 'req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:26.153655 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] The token cache is being invalidate because project 64134efc911b4b4bb507a3d4ab5b37dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:26.153972 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:26.154653 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-f5f6ed4e-cd00-4c9e-a99e-de68914e920d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:26.156253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1383/2737] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:26 2022] DELETE /identity/v3/projects/64134efc911b4b4bb507a3d4ab5b37dd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:26.161645 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1b15-42c9-4922-88cd-98140e3fe100 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.162019 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1b15-42c9-4922-88cd-98140e3fe100 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.162332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a1b15-42c9-4922-88cd-98140e3fe100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.181201 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-df4a1b15-42c9-4922-88cd-98140e3fe100 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:26.182450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-df4a1b15-42c9-4922-88cd-98140e3fe100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:26.247089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1355/2738] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:26.254812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a273-a5bc-4acd-b7c6-eae78dc00cd3 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.255105 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a273-a5bc-4acd-b7c6-eae78dc00cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.255386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10a273-a5bc-4acd-b7c6-eae78dc00cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.274446 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-de10a273-a5bc-4acd-b7c6-eae78dc00cd3 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:26.275701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-de10a273-a5bc-4acd-b7c6-eae78dc00cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:26.284277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1384/2739] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:26.288497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a1b15-42c9-4922-88cd-98140e3fe100 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.298582 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a1b15-42c9-4922-88cd-98140e3fe100 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.303638 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35575695-4250-4a24-850d-66145173c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.304284 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35575695-4250-4a24-850d-66145173c1de admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.304559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35575695-4250-4a24-850d-66145173c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.304829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35575695-4250-4a24-850d-66145173c1de admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.305546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35575695-4250-4a24-850d-66145173c1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:51:26.305849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35575695-4250-4a24-850d-66145173c1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.307475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35575695-4250-4a24-850d-66145173c1de admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.320210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1356/2740] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:51:26.324539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10a273-a5bc-4acd-b7c6-eae78dc00cd3 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.334074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10a273-a5bc-4acd-b7c6-eae78dc00cd3 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.339291 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c898f-8ccb-421a-b919-39308e29ac02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.339985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c898f-8ccb-421a-b919-39308e29ac02 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.340269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c898f-8ccb-421a-b919-39308e29ac02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.340545 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c898f-8ccb-421a-b919-39308e29ac02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.341282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c898f-8ccb-421a-b919-39308e29ac02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.343284 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c898f-8ccb-421a-b919-39308e29ac02 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.375527 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1385/2741] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:26 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:26.379999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35575695-4250-4a24-850d-66145173c1de admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.390689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35575695-4250-4a24-850d-66145173c1de admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.448767 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e981-6a12-4ed9-a34a-f2a3d432c58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.449454 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e981-6a12-4ed9-a34a-f2a3d432c58b admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.449735 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e981-6a12-4ed9-a34a-f2a3d432c58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.450041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e981-6a12-4ed9-a34a-f2a3d432c58b admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.450940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e981-6a12-4ed9-a34a-f2a3d432c58b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.454498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e981-6a12-4ed9-a34a-f2a3d432c58b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.477504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1357/2742] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:26 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:26.482392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c898f-8ccb-421a-b919-39308e29ac02 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.493448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c898f-8ccb-421a-b919-39308e29ac02 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.498443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365f198-6836-4368-a5b2-d296ac75fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.499112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365f198-6836-4368-a5b2-d296ac75fb26 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.499395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365f198-6836-4368-a5b2-d296ac75fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.499695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365f198-6836-4368-a5b2-d296ac75fb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.500428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365f198-6836-4368-a5b2-d296ac75fb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.502055 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365f198-6836-4368-a5b2-d296ac75fb26 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.513017 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1386/2743] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:26.517214 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e981-6a12-4ed9-a34a-f2a3d432c58b admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.532239 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e981-6a12-4ed9-a34a-f2a3d432c58b admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.537246 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92249c76-38f9-4752-ace3-bb095873acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.537848 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92249c76-38f9-4752-ace3-bb095873acaa admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.538162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92249c76-38f9-4752-ace3-bb095873acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.538439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92249c76-38f9-4752-ace3-bb095873acaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.539170 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92249c76-38f9-4752-ace3-bb095873acaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.540779 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92249c76-38f9-4752-ace3-bb095873acaa admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.551511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1358/2744] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:26.555561 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365f198-6836-4368-a5b2-d296ac75fb26 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.566019 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365f198-6836-4368-a5b2-d296ac75fb26 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.572378 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68131c-853e-4553-b921-e8f3c438e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.573739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68131c-853e-4553-b921-e8f3c438e88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.574215 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68131c-853e-4553-b921-e8f3c438e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.574609 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68131c-853e-4553-b921-e8f3c438e88d admin admin] PATH_INFO: `/v3/projects/e8e070e6b65f4cf4b343861621f17257/users/a0780201758b44a7a3cdc70f6ea7c987/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.595095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68131c-853e-4553-b921-e8f3c438e88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8e070e6b65f4cf4b343861621f17257, user_id=a0780201758b44a7a3cdc70f6ea7c987, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.597741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68131c-853e-4553-b921-e8f3c438e88d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.613525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1387/2745] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:26 2022] PUT /identity/v3/projects/e8e070e6b65f4cf4b343861621f17257/users/a0780201758b44a7a3cdc70f6ea7c987/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:51:26.625004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ca373-1d1d-446f-a360-9031e78564e8 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.625290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ca373-1d1d-446f-a360-9031e78564e8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.625566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ca373-1d1d-446f-a360-9031e78564e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.652116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-5f5ca373-1d1d-446f-a360-9031e78564e8 None None] MFA Rules not processed for user `a0780201758b44a7a3cdc70f6ea7c987`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:26.653353 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5f5ca373-1d1d-446f-a360-9031e78564e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:26.688217 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:26.721522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1359/2746] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:26.726394 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68131c-853e-4553-b921-e8f3c438e88d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.791309 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68131c-853e-4553-b921-e8f3c438e88d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.796871 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e409e2-9cce-43f5-bd90-a3f726323594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.797978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e409e2-9cce-43f5-bd90-a3f726323594 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.797978 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e409e2-9cce-43f5-bd90-a3f726323594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.798164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e409e2-9cce-43f5-bd90-a3f726323594 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.798819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e409e2-9cce-43f5-bd90-a3f726323594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.800755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e409e2-9cce-43f5-bd90-a3f726323594 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.834612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1388/2747] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:26 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:26.838765 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ca373-1d1d-446f-a360-9031e78564e8 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.849732 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ca373-1d1d-446f-a360-9031e78564e8 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.909788 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8d6aa-7a5e-427c-9642-a71691b72f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.910497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d6aa-7a5e-427c-9642-a71691b72f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.910785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d6aa-7a5e-427c-9642-a71691b72f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.911064 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8d6aa-7a5e-427c-9642-a71691b72f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.911764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8d6aa-7a5e-427c-9642-a71691b72f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.913687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8d6aa-7a5e-427c-9642-a71691b72f88 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.937378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1360/2748] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:26 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:26.938612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e409e2-9cce-43f5-bd90-a3f726323594 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.949900 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e409e2-9cce-43f5-bd90-a3f726323594 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.955226 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b31d06-01c5-48f6-8eba-d384850d9e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.955957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31d06-01c5-48f6-8eba-d384850d9e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.956287 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31d06-01c5-48f6-8eba-d384850d9e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.956759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b31d06-01c5-48f6-8eba-d384850d9e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.957405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b31d06-01c5-48f6-8eba-d384850d9e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.959221 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b31d06-01c5-48f6-8eba-d384850d9e30 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:26.970384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1389/2749] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:51:26.974517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8d6aa-7a5e-427c-9642-a71691b72f88 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:26.988382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8d6aa-7a5e-427c-9642-a71691b72f88 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:26.994260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4594452-9e1a-4347-b57b-dfd0bdee0223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:26.994933 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594452-9e1a-4347-b57b-dfd0bdee0223 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:26.995219 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594452-9e1a-4347-b57b-dfd0bdee0223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:26.995497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4594452-9e1a-4347-b57b-dfd0bdee0223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:26.996244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4594452-9e1a-4347-b57b-dfd0bdee0223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:26.997977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4594452-9e1a-4347-b57b-dfd0bdee0223 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.010099 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1361/2750] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:27.014668 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b31d06-01c5-48f6-8eba-d384850d9e30 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.025281 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b31d06-01c5-48f6-8eba-d384850d9e30 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.031095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6608c-6fe2-42f5-a4c2-ddd9562eb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.031991 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6608c-6fe2-42f5-a4c2-ddd9562eb464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.032320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6608c-6fe2-42f5-a4c2-ddd9562eb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.032598 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6608c-6fe2-42f5-a4c2-ddd9562eb464 admin admin] PATH_INFO: `/v3/projects/75795707a2a7409c9e424f96b679ad71/users/cc2cf120d15d4d2f918d22f1895062a4/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.049377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6608c-6fe2-42f5-a4c2-ddd9562eb464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75795707a2a7409c9e424f96b679ad71, user_id=cc2cf120d15d4d2f918d22f1895062a4, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:27.052801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6608c-6fe2-42f5-a4c2-ddd9562eb464 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.069651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1390/2751] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:27 2022] PUT /identity/v3/projects/75795707a2a7409c9e424f96b679ad71/users/cc2cf120d15d4d2f918d22f1895062a4/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:27.080358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb628254-2145-4200-b3c4-5178c5aafe4c None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.080649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb628254-2145-4200-b3c4-5178c5aafe4c None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.080924 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb628254-2145-4200-b3c4-5178c5aafe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.109858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-eb628254-2145-4200-b3c4-5178c5aafe4c None None] MFA Rules not processed for user `cc2cf120d15d4d2f918d22f1895062a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:27.111098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-eb628254-2145-4200-b3c4-5178c5aafe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:27.176597 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1362/2752] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:27.181277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6608c-6fe2-42f5-a4c2-ddd9562eb464 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.205462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:27.249188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6608c-6fe2-42f5-a4c2-ddd9562eb464 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.254889 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05bf3-0492-473f-bbe9-bf49f6aae16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.255626 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05bf3-0492-473f-bbe9-bf49f6aae16d admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.255917 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05bf3-0492-473f-bbe9-bf49f6aae16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.256189 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b05bf3-0492-473f-bbe9-bf49f6aae16d admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.256919 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b05bf3-0492-473f-bbe9-bf49f6aae16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:27.258881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b05bf3-0492-473f-bbe9-bf49f6aae16d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.288147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1391/2753] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:27 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:27.292536 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb628254-2145-4200-b3c4-5178c5aafe4c None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.304439 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb628254-2145-4200-b3c4-5178c5aafe4c None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.349245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:27.368428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0b3f5-0f8d-41f5-b65e-ea8cca852212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.369515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b3f5-0f8d-41f5-b65e-ea8cca852212 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.369931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b3f5-0f8d-41f5-b65e-ea8cca852212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.370648 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0b3f5-0f8d-41f5-b65e-ea8cca852212 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.370935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0b3f5-0f8d-41f5-b65e-ea8cca852212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:27.373090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0b3f5-0f8d-41f5-b65e-ea8cca852212 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.400623 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1363/2754] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:27 2022] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:27.405334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05bf3-0492-473f-bbe9-bf49f6aae16d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.416520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b05bf3-0492-473f-bbe9-bf49f6aae16d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.422367 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd820da-d47c-4d18-9d59-82b4b8facc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.423299 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd820da-d47c-4d18-9d59-82b4b8facc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.423647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd820da-d47c-4d18-9d59-82b4b8facc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.423987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd820da-d47c-4d18-9d59-82b4b8facc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.424823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd820da-d47c-4d18-9d59-82b4b8facc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:27.426526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd820da-d47c-4d18-9d59-82b4b8facc73 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.438035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1392/2755] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:27.442701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0b3f5-0f8d-41f5-b65e-ea8cca852212 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.455636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0b3f5-0f8d-41f5-b65e-ea8cca852212 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.462508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2733-7d24-4c17-8226-27c70af2b1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.463526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2733-7d24-4c17-8226-27c70af2b1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.463905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2733-7d24-4c17-8226-27c70af2b1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.464278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a2733-7d24-4c17-8226-27c70af2b1e5 admin admin] PATH_INFO: `/v3/projects/7a49b884b0464d43b3a51d883b2b3463/users/ba02fd2f4e5049eb84e5b3a3080b85af/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.481009 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a2733-7d24-4c17-8226-27c70af2b1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a49b884b0464d43b3a51d883b2b3463, user_id=ba02fd2f4e5049eb84e5b3a3080b85af, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:27.483820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a2733-7d24-4c17-8226-27c70af2b1e5 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.506580 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1364/2756] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:27 2022] PUT /identity/v3/projects/7a49b884b0464d43b3a51d883b2b3463/users/ba02fd2f4e5049eb84e5b3a3080b85af/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:27.511079 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd820da-d47c-4d18-9d59-82b4b8facc73 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.524236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd820da-d47c-4d18-9d59-82b4b8facc73 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.590936 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bda1e6-a60a-4a77-8e15-5aabf92a7738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.591853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda1e6-a60a-4a77-8e15-5aabf92a7738 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.592179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda1e6-a60a-4a77-8e15-5aabf92a7738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.592413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda1e6-a60a-4a77-8e15-5aabf92a7738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.593151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bda1e6-a60a-4a77-8e15-5aabf92a7738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:27.594800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bda1e6-a60a-4a77-8e15-5aabf92a7738 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.609997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1393/2757] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:27.613634 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2733-7d24-4c17-8226-27c70af2b1e5 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.626293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a2733-7d24-4c17-8226-27c70af2b1e5 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.632466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.633481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.633845 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.634188 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] PATH_INFO: `/v3/projects/7a49b884b0464d43b3a51d883b2b3463/users/ba02fd2f4e5049eb84e5b3a3080b85af/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.636476 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a49b884b0464d43b3a51d883b2b3463, user_id=ba02fd2f4e5049eb84e5b3a3080b85af, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:27.639321 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.664479 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1365/2758] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:27 2022] PUT /identity/v3/projects/7a49b884b0464d43b3a51d883b2b3463/users/ba02fd2f4e5049eb84e5b3a3080b85af/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:27.666372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02c4a-c7c7-4fab-b092-46cf58b0e3aa None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.666669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02c4a-c7c7-4fab-b092-46cf58b0e3aa None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.667087 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f02c4a-c7c7-4fab-b092-46cf58b0e3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.700772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c9f02c4a-c7c7-4fab-b092-46cf58b0e3aa None None] MFA Rules not processed for user `ba02fd2f4e5049eb84e5b3a3080b85af`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:27.702039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c9f02c4a-c7c7-4fab-b092-46cf58b0e3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:27.791748 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1394/2759] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:27.807863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.807863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:27.873097 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b3f59-bb60-4537-b40c-47d998937f85 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.877034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762051-9e18-4149-b614-4a1c1252da31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.877751 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762051-9e18-4149-b614-4a1c1252da31 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.878118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762051-9e18-4149-b614-4a1c1252da31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.878396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01762051-9e18-4149-b614-4a1c1252da31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.888234 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01762051-9e18-4149-b614-4a1c1252da31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:27.889678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01762051-9e18-4149-b614-4a1c1252da31 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:27.902041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1366/2760] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:27.946204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f02c4a-c7c7-4fab-b092-46cf58b0e3aa None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:27.958403 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f02c4a-c7c7-4fab-b092-46cf58b0e3aa None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:27.963472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0a361-6811-42fe-bc07-020fafec7236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:27.964395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0a361-6811-42fe-bc07-020fafec7236 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:27.964755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0a361-6811-42fe-bc07-020fafec7236 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:27.965051 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0a361-6811-42fe-bc07-020fafec7236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:27.979185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:28.031533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0a361-6811-42fe-bc07-020fafec7236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:28.033035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0a361-6811-42fe-bc07-020fafec7236 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:28.042346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1395/2761] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:36.259363 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762051-9e18-4149-b614-4a1c1252da31 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:36.332171 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01762051-9e18-4149-b614-4a1c1252da31 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:36.340449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:36.341354 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:36.341620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:36.341912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] PATH_INFO: `/v3/users/a0780201758b44a7a3cdc70f6ea7c987` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:36.343277 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0780201758b44a7a3cdc70f6ea7c987)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:36.345379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:36.394169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:36.401218 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0780201758b44a7a3cdc70f6ea7c987'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:36.402589 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0780201758b44a7a3cdc70f6ea7c987'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:36.412410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0780201758b44a7a3cdc70f6ea7c987'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:36.419888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0780201758b44a7a3cdc70f6ea7c987'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:36.432396 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0780201758b44a7a3cdc70f6ea7c987'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:36.438882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1367/2762] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:36 2022] DELETE /identity/v3/users/a0780201758b44a7a3cdc70f6ea7c987 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:36.443952 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b9ed-b60f-49ac-8a55-b76ee8bef7e2 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:36.444516 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b9ed-b60f-49ac-8a55-b76ee8bef7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:36.444627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b9ed-b60f-49ac-8a55-b76ee8bef7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:36.462520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-a3e6b9ed-b60f-49ac-8a55-b76ee8bef7e2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:36.463726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a3e6b9ed-b60f-49ac-8a55-b76ee8bef7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:36.531539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1396/2763] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:36.541689 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:36.543307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:36.608695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee337f4-c32d-4b8a-aa1a-e193f764d620 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:36.613256 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9580ca-be04-463d-997c-2f05817026db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:36.614682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9580ca-be04-463d-997c-2f05817026db service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:36.615122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9580ca-be04-463d-997c-2f05817026db service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:36.615575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9580ca-be04-463d-997c-2f05817026db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:36.630538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9580ca-be04-463d-997c-2f05817026db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:36.632148 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9580ca-be04-463d-997c-2f05817026db service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:36.642415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1368/2764] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:36.926601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6b9ed-b60f-49ac-8a55-b76ee8bef7e2 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:36.928058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a3e6b9ed-b60f-49ac-8a55-b76ee8bef7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:36.942406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6b9ed-b60f-49ac-8a55-b76ee8bef7e2 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:36.947349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:36.948241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:36.948526 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:36.948802 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] PATH_INFO: `/v3/projects/e8e070e6b65f4cf4b343861621f17257` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:36.950060 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8e070e6b65f4cf4b343861621f17257)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:36.952047 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:37.001156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8e070e6b65f4cf4b343861621f17257', 'request_id': 'req-e11a1308-5a7f-4d87-87b8-567aa914705b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.010005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8e070e6b65f4cf4b343861621f17257', 'request_id': 'req-e11a1308-5a7f-4d87-87b8-567aa914705b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.015777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8e070e6b65f4cf4b343861621f17257', 'request_id': 'req-e11a1308-5a7f-4d87-87b8-567aa914705b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.027136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] The token cache is being invalidate because project e8e070e6b65f4cf4b343861621f17257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:37.027422 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.028073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.029797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1397/2765] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:36 2022] DELETE /identity/v3/projects/e8e070e6b65f4cf4b343861621f17257 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:37.034006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9580ca-be04-463d-997c-2f05817026db service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:37.044415 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9580ca-be04-463d-997c-2f05817026db service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:37.109604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:37.110419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:37.110702 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:37.110977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] PATH_INFO: `/v3/users/cc2cf120d15d4d2f918d22f1895062a4` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:37.112841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2cf120d15d4d2f918d22f1895062a4)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:37.115014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:37.164903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2cf120d15d4d2f918d22f1895062a4'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.165550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2cf120d15d4d2f918d22f1895062a4'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.174018 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2cf120d15d4d2f918d22f1895062a4'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.181841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2cf120d15d4d2f918d22f1895062a4'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.183326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:37.198999 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2cf120d15d4d2f918d22f1895062a4'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.208619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1369/2766] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:37 2022] DELETE /identity/v3/users/cc2cf120d15d4d2f918d22f1895062a4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:37.492056 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:37.494063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:37.525255 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a1308-5a7f-4d87-87b8-567aa914705b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:37.562899 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:37.591252 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:37.592135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:37.592418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:37.593187 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] PATH_INFO: `/v3/projects/75795707a2a7409c9e424f96b679ad71` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:37.594501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75795707a2a7409c9e424f96b679ad71)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:37.596515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:37.648565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75795707a2a7409c9e424f96b679ad71', 'request_id': 'req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.657122 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75795707a2a7409c9e424f96b679ad71', 'request_id': 'req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.663437 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75795707a2a7409c9e424f96b679ad71', 'request_id': 'req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.676962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] The token cache is being invalidate because project 75795707a2a7409c9e424f96b679ad71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:37.677311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.678028 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.679704 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1398/2767] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:37 2022] DELETE /identity/v3/projects/75795707a2a7409c9e424f96b679ad71 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:37.683709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:37.685206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:37.698617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39381ef-dbc6-49ca-92c4-cb6741302268 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:37.758657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:37.759550 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:37.759827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:37.760098 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] PATH_INFO: `/v3/users/ba02fd2f4e5049eb84e5b3a3080b85af` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:37.761287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba02fd2f4e5049eb84e5b3a3080b85af)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:37.763373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:37.825522 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba02fd2f4e5049eb84e5b3a3080b85af'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.826229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba02fd2f4e5049eb84e5b3a3080b85af'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.836298 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba02fd2f4e5049eb84e5b3a3080b85af'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.846229 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba02fd2f4e5049eb84e5b3a3080b85af'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.860385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-c0b76e26-9854-4166-b206-510f85278484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba02fd2f4e5049eb84e5b3a3080b85af'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:37.868066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1370/2768] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:37 2022] DELETE /identity/v3/users/ba02fd2f4e5049eb84e5b3a3080b85af => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:38.176976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:38.178540 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:38.195372 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5f6fa-6b92-43f4-8cdb-23bc73664d5f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:38.260780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:38.261758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.262090 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.262390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] PATH_INFO: `/v3/projects/7a49b884b0464d43b3a51d883b2b3463` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.263800 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a49b884b0464d43b3a51d883b2b3463)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:38.265921 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:38.317432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a49b884b0464d43b3a51d883b2b3463', 'request_id': 'req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:38.325269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a49b884b0464d43b3a51d883b2b3463', 'request_id': 'req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:38.331509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a49b884b0464d43b3a51d883b2b3463', 'request_id': 'req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:38.338945 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:38.344377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] The token cache is being invalidate because project 7a49b884b0464d43b3a51d883b2b3463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:38.344819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:38.345625 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-5ffa9aef-dc1a-4a74-af09-e3feed5d793a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:38.347813 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1399/2769] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:38 2022] DELETE /identity/v3/projects/7a49b884b0464d43b3a51d883b2b3463 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:38.354008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ece2c4-f7c8-44a5-b0b8-e61952fcacc8 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.354317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ece2c4-f7c8-44a5-b0b8-e61952fcacc8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.354593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ece2c4-f7c8-44a5-b0b8-e61952fcacc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.373579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a0ece2c4-f7c8-44a5-b0b8-e61952fcacc8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:38.374835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a0ece2c4-f7c8-44a5-b0b8-e61952fcacc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:38.427080 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:38.437608 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1371/2770] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:38.447467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b35b48-1791-4fe6-ad84-04fc4b5c8655 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.447758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b35b48-1791-4fe6-ad84-04fc4b5c8655 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.448038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b35b48-1791-4fe6-ad84-04fc4b5c8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.467406 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-67b35b48-1791-4fe6-ad84-04fc4b5c8655 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:38.468638 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-67b35b48-1791-4fe6-ad84-04fc4b5c8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:38.477049 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1400/2771] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:51:38.481314 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ece2c4-f7c8-44a5-b0b8-e61952fcacc8 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:38.491701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ece2c4-f7c8-44a5-b0b8-e61952fcacc8 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:38.496857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:38.497511 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.497905 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.498222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.498945 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:51:38.499250 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:38.500880 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:38.512502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1372/2772] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:51:38.516992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b35b48-1791-4fe6-ad84-04fc4b5c8655 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:38.526718 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b35b48-1791-4fe6-ad84-04fc4b5c8655 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:38.532427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4ec8-cafc-4224-b103-0f63771b7811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:38.533080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4ec8-cafc-4224-b103-0f63771b7811 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.533360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4ec8-cafc-4224-b103-0f63771b7811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.533643 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee4ec8-cafc-4224-b103-0f63771b7811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.534450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee4ec8-cafc-4224-b103-0f63771b7811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:38.536414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee4ec8-cafc-4224-b103-0f63771b7811 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:38.569251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1401/2773] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:38 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:38.573440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:38.584318 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3eedad-09b5-4cb0-ab0d-514bbc912ef7 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:38.641544 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cf457-586a-4258-9c11-2d6b5c979b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:38.642249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf457-586a-4258-9c11-2d6b5c979b8f admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.642533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf457-586a-4258-9c11-2d6b5c979b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.642914 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf457-586a-4258-9c11-2d6b5c979b8f admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.643622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cf457-586a-4258-9c11-2d6b5c979b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:38.646681 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cf457-586a-4258-9c11-2d6b5c979b8f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:38.669014 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1373/2774] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:38 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:38.673300 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4ec8-cafc-4224-b103-0f63771b7811 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:38.684280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee4ec8-cafc-4224-b103-0f63771b7811 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:38.689099 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5dc57-d667-4c20-a266-f04737b6de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:38.689758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5dc57-d667-4c20-a266-f04737b6de51 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.690075 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5dc57-d667-4c20-a266-f04737b6de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.690353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5dc57-d667-4c20-a266-f04737b6de51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.691428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5dc57-d667-4c20-a266-f04737b6de51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:38.693024 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5dc57-d667-4c20-a266-f04737b6de51 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:38.703574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1402/2775] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:38.707500 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cf457-586a-4258-9c11-2d6b5c979b8f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:38.717862 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cf457-586a-4258-9c11-2d6b5c979b8f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:38.722934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899fbe0-22dc-48f2-a9b0-b7d2cff06bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:38.723598 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899fbe0-22dc-48f2-a9b0-b7d2cff06bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.723855 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899fbe0-22dc-48f2-a9b0-b7d2cff06bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.724140 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899fbe0-22dc-48f2-a9b0-b7d2cff06bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.724864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899fbe0-22dc-48f2-a9b0-b7d2cff06bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:38.726633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899fbe0-22dc-48f2-a9b0-b7d2cff06bb7 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:38.736841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1374/2776] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:38.740997 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5dc57-d667-4c20-a266-f04737b6de51 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:38.751239 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5dc57-d667-4c20-a266-f04737b6de51 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:38.756496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:38.757425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.757710 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.757987 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] PATH_INFO: `/v3/projects/484af3ed0ddf4a059bb9d1a45eaf5c32/users/bd4bd5eb445e43ddb8ab0c9556d4560c/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.774134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=484af3ed0ddf4a059bb9d1a45eaf5c32, user_id=bd4bd5eb445e43ddb8ab0c9556d4560c, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:38.776816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:38.794985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1403/2777] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:38 2022] PUT /identity/v3/projects/484af3ed0ddf4a059bb9d1a45eaf5c32/users/bd4bd5eb445e43ddb8ab0c9556d4560c/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:38.812184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c84255-c3ba-4c18-80f8-475f038427a9 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.812538 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c84255-c3ba-4c18-80f8-475f038427a9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.812890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c84255-c3ba-4c18-80f8-475f038427a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:38.842975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-e4c84255-c3ba-4c18-80f8-475f038427a9 None None] MFA Rules not processed for user `bd4bd5eb445e43ddb8ab0c9556d4560c`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:38.844228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e4c84255-c3ba-4c18-80f8-475f038427a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:38.914863 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1375/2778] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:38.926212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:38.928273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:38.989974 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed47f4-bdc6-4493-afb4-5bcfee232e17 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:38.993859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529587e-44f3-45e7-976b-482dba4a2b6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:38.994552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529587e-44f3-45e7-976b-482dba4a2b6d service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:38.994837 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529587e-44f3-45e7-976b-482dba4a2b6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:38.995116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529587e-44f3-45e7-976b-482dba4a2b6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:39.004289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529587e-44f3-45e7-976b-482dba4a2b6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:39.005829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529587e-44f3-45e7-976b-482dba4a2b6d service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:39.015312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1404/2779] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:39.154497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c84255-c3ba-4c18-80f8-475f038427a9 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:39.155922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-e4c84255-c3ba-4c18-80f8-475f038427a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:39.220183 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:39.228198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c84255-c3ba-4c18-80f8-475f038427a9 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:39.233424 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:39.234341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:39.234885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:39.234885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] PATH_INFO: `/v3/users/281d0550b11447989b3c84fb7cf3529b` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:39.236102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281d0550b11447989b3c84fb7cf3529b)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:39.238093 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:39.308407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281d0550b11447989b3c84fb7cf3529b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.309163 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281d0550b11447989b3c84fb7cf3529b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.319086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281d0550b11447989b3c84fb7cf3529b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.328316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281d0550b11447989b3c84fb7cf3529b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.342622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281d0550b11447989b3c84fb7cf3529b'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.348922 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1376/2780] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:39 2022] DELETE /identity/v3/users/281d0550b11447989b3c84fb7cf3529b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:39.353397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb79f45-ba91-48a1-8ca2-acd8535935cb None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:39.353689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb79f45-ba91-48a1-8ca2-acd8535935cb None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:39.353986 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb79f45-ba91-48a1-8ca2-acd8535935cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:39.371672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-8eb79f45-ba91-48a1-8ca2-acd8535935cb None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:39.372918 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8eb79f45-ba91-48a1-8ca2-acd8535935cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:39.432687 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1405/2781] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:39.444482 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:39.446089 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:39.506075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e5cc1-88e5-4edd-bdb1-8af1de114819 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:39.509968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d27ef-727a-4ab3-9dbe-5ab7ea01fccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:39.510619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d27ef-727a-4ab3-9dbe-5ab7ea01fccc service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:39.510903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d27ef-727a-4ab3-9dbe-5ab7ea01fccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:39.511179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d27ef-727a-4ab3-9dbe-5ab7ea01fccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:39.520667 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d27ef-727a-4ab3-9dbe-5ab7ea01fccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:39.522220 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d27ef-727a-4ab3-9dbe-5ab7ea01fccc service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:39.534388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1377/2782] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:39.824770 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb79f45-ba91-48a1-8ca2-acd8535935cb None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:39.826454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-8eb79f45-ba91-48a1-8ca2-acd8535935cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:39.840097 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb79f45-ba91-48a1-8ca2-acd8535935cb None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:39.850635 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:39.850909 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:39.851078 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:39.851387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] PATH_INFO: `/v3/projects/579498cffbc64d79b07ba01ebbd71721` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:39.852803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=579498cffbc64d79b07ba01ebbd71721)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:39.854791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:39.897665 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:39.913539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579498cffbc64d79b07ba01ebbd71721', 'request_id': 'req-feedf0ee-11d2-410e-a16b-2736c7691965'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.921742 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579498cffbc64d79b07ba01ebbd71721', 'request_id': 'req-feedf0ee-11d2-410e-a16b-2736c7691965'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.927533 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579498cffbc64d79b07ba01ebbd71721', 'request_id': 'req-feedf0ee-11d2-410e-a16b-2736c7691965'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.939817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] The token cache is being invalidate because project 579498cffbc64d79b07ba01ebbd71721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:39.940112 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.940798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-feedf0ee-11d2-410e-a16b-2736c7691965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:39.942739 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1406/2783] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:39 2022] DELETE /identity/v3/projects/579498cffbc64d79b07ba01ebbd71721 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:39.948000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a21f-c303-42e7-81bf-6b3f9fcb27c8 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:39.948553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a21f-c303-42e7-81bf-6b3f9fcb27c8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:39.948553 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0a21f-c303-42e7-81bf-6b3f9fcb27c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:39.966839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-daa0a21f-c303-42e7-81bf-6b3f9fcb27c8 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:39.968054 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-daa0a21f-c303-42e7-81bf-6b3f9fcb27c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:40.028620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1378/2784] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:40.036519 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7df8cf-780e-4228-bfaa-a88d43973651 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.036821 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7df8cf-780e-4228-bfaa-a88d43973651 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.037095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7df8cf-780e-4228-bfaa-a88d43973651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.056243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-dd7df8cf-780e-4228-bfaa-a88d43973651 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:40.057478 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-dd7df8cf-780e-4228-bfaa-a88d43973651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:40.075220 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1407/2785] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:40.075417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0a21f-c303-42e7-81bf-6b3f9fcb27c8 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:40.084273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0a21f-c303-42e7-81bf-6b3f9fcb27c8 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:40.088909 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:40.089624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.089903 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.090202 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.090956 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:51:40.091489 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:40.093088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:40.108147 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1379/2786] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 19:51:40.109273 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7df8cf-780e-4228-bfaa-a88d43973651 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:40.118981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7df8cf-780e-4228-bfaa-a88d43973651 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:40.124146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86ab0-8e65-4992-8268-c7635303f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:40.124881 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86ab0-8e65-4992-8268-c7635303f28c admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.125233 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86ab0-8e65-4992-8268-c7635303f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.125574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f86ab0-8e65-4992-8268-c7635303f28c admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.126574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f86ab0-8e65-4992-8268-c7635303f28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:40.128584 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f86ab0-8e65-4992-8268-c7635303f28c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:40.161165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1408/2787] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:40 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:51:40.165729 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:40.173416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:40.177931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3847-4c57-40e5-8124-4a6b99301479 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:40.259378 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:40.260324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.260696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.261043 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.261827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:40.264290 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:40.293966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1380/2788] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:40 2022] POST /identity/v3/users => generated 286 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:40.295947 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86ab0-8e65-4992-8268-c7635303f28c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:40.308214 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f86ab0-8e65-4992-8268-c7635303f28c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:40.315501 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb36c2-2d42-4624-a15f-b6626d49716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:40.316631 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb36c2-2d42-4624-a15f-b6626d49716c admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.324400 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:40.325647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb36c2-2d42-4624-a15f-b6626d49716c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.326096 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb36c2-2d42-4624-a15f-b6626d49716c admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.326437 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:40.327115 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb36c2-2d42-4624-a15f-b6626d49716c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:40.328850 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb36c2-2d42-4624-a15f-b6626d49716c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:40.340824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1409/2789] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:40.345074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb36c2-2d42-4624-a15f-b6626d49716c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:40.356355 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb36c2-2d42-4624-a15f-b6626d49716c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:40.364258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba18bdc-2400-40d1-b99b-f84ec01c4874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:40.365251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba18bdc-2400-40d1-b99b-f84ec01c4874 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.365539 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba18bdc-2400-40d1-b99b-f84ec01c4874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.365814 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba18bdc-2400-40d1-b99b-f84ec01c4874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.366649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba18bdc-2400-40d1-b99b-f84ec01c4874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:40.369001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba18bdc-2400-40d1-b99b-f84ec01c4874 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:40.381976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1410/2790] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:40.386352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba18bdc-2400-40d1-b99b-f84ec01c4874 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:40.403627 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba18bdc-2400-40d1-b99b-f84ec01c4874 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:40.410262 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378af1a-7645-4155-a59c-e50b269ab69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:40.411798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378af1a-7645-4155-a59c-e50b269ab69b admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.412089 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378af1a-7645-4155-a59c-e50b269ab69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.412371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378af1a-7645-4155-a59c-e50b269ab69b admin admin] PATH_INFO: `/v3/projects/b84b72d5e3f845de93e81c466f4eb7f9/users/5124fcefa3f34db4bbdb129fce668f6c/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.431395 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378af1a-7645-4155-a59c-e50b269ab69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84b72d5e3f845de93e81c466f4eb7f9, user_id=5124fcefa3f34db4bbdb129fce668f6c, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:40.434169 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378af1a-7645-4155-a59c-e50b269ab69b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:40.452624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1411/2791] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:40 2022] PUT /identity/v3/projects/b84b72d5e3f845de93e81c466f4eb7f9/users/5124fcefa3f34db4bbdb129fce668f6c/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:51:40.465536 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee2db-3144-49f0-83e7-f16d2f692fb8 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.465823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee2db-3144-49f0-83e7-f16d2f692fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.466136 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ee2db-3144-49f0-83e7-f16d2f692fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.488841 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5e37-b39b-402e-afb5-1bed60a325a0 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:40.500541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-c49ee2db-3144-49f0-83e7-f16d2f692fb8 None None] MFA Rules not processed for user `5124fcefa3f34db4bbdb129fce668f6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:40.501769 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c49ee2db-3144-49f0-83e7-f16d2f692fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:40.554373 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:40.563186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:40.563864 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.564138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.564412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.576279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:40.582314 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1412/2792] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:40.591334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee2db-3144-49f0-83e7-f16d2f692fb8 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:40.592874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c49ee2db-3144-49f0-83e7-f16d2f692fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:40.599317 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:40.601734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:40.614061 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1381/2793] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:51:40.636551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:40.657294 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ee2db-3144-49f0-83e7-f16d2f692fb8 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:40.661172 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a37d08-bf77-4d24-b402-b5d0f15e7ed5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1a1889e2fb436a86c5e68bf9f1e608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:40.661824 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37d08-bf77-4d24-b402-b5d0f15e7ed5 service glance] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:40.662149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37d08-bf77-4d24-b402-b5d0f15e7ed5 service glance] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:40.662431 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37d08-bf77-4d24-b402-b5d0f15e7ed5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:40.670812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a37d08-bf77-4d24-b402-b5d0f15e7ed5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:40.672280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a37d08-bf77-4d24-b402-b5d0f15e7ed5 service glance] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:40.681693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1413/2794] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:50.610077 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=4 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:50.677350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=10 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:52.689686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:52.691883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:52.764688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b641972-952a-495d-aa95-bc17619ee40a service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:52.770815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:52.772034 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:52.772359 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:52.772942 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] PATH_INFO: `/v3/users/bd4bd5eb445e43ddb8ab0c9556d4560c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:52.774773 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd4bd5eb445e43ddb8ab0c9556d4560c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:52.778506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:52.833280 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd4bd5eb445e43ddb8ab0c9556d4560c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:52.833985 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd4bd5eb445e43ddb8ab0c9556d4560c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:52.843045 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd4bd5eb445e43ddb8ab0c9556d4560c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:52.850365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd4bd5eb445e43ddb8ab0c9556d4560c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:52.862241 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd4bd5eb445e43ddb8ab0c9556d4560c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:52.868586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1382/2795] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:51:52 2022] DELETE /identity/v3/users/bd4bd5eb445e43ddb8ab0c9556d4560c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:52.874695 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d376f-71aa-40f3-9f04-2426c72e68b6 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:52.875241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d376f-71aa-40f3-9f04-2426c72e68b6 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:52.875241 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d376f-71aa-40f3-9f04-2426c72e68b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:52.894231 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-d00d376f-71aa-40f3-9f04-2426c72e68b6 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:52.896377 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d00d376f-71aa-40f3-9f04-2426c72e68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:52.962741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1414/2796] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:52.972510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:52.974224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:53.034813 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa4b7e-3378-488f-9ecc-497e913d90d4 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:53.041313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9a35b-6bb5-474b-ba38-5440946c9a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:53.042346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a35b-6bb5-474b-ba38-5440946c9a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.042775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a35b-6bb5-474b-ba38-5440946c9a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.043134 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9a35b-6bb5-474b-ba38-5440946c9a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.054358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9a35b-6bb5-474b-ba38-5440946c9a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:53.055815 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9a35b-6bb5-474b-ba38-5440946c9a86 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:53.068775 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1383/2797] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:51:53.368330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d376f-71aa-40f3-9f04-2426c72e68b6 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:53.369840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d00d376f-71aa-40f3-9f04-2426c72e68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:53.387541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d376f-71aa-40f3-9f04-2426c72e68b6 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:53.392565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:53.393649 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.393755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.394346 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] PATH_INFO: `/v3/projects/484af3ed0ddf4a059bb9d1a45eaf5c32` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.398064 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] RBAC: Authorizing `identity:delete_project(project_id=484af3ed0ddf4a059bb9d1a45eaf5c32)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:53.400133 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:53.449381 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484af3ed0ddf4a059bb9d1a45eaf5c32', 'request_id': 'req-4889e4bb-3633-45c1-8dfe-27e47234412d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:53.460125 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484af3ed0ddf4a059bb9d1a45eaf5c32', 'request_id': 'req-4889e4bb-3633-45c1-8dfe-27e47234412d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:53.466615 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484af3ed0ddf4a059bb9d1a45eaf5c32', 'request_id': 'req-4889e4bb-3633-45c1-8dfe-27e47234412d'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:53.479349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] The token cache is being invalidate because project 484af3ed0ddf4a059bb9d1a45eaf5c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:51:53.479669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:53.480600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4889e4bb-3633-45c1-8dfe-27e47234412d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:51:53.482326 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1415/2798] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:51:53 2022] DELETE /identity/v3/projects/484af3ed0ddf4a059bb9d1a45eaf5c32 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:53.488397 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6fa4-bf0a-40f4-abb1-9db510fa6b6f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.488709 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6fa4-bf0a-40f4-abb1-9db510fa6b6f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.488982 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c6fa4-bf0a-40f4-abb1-9db510fa6b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.509586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-821c6fa4-bf0a-40f4-abb1-9db510fa6b6f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:53.510835 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-821c6fa4-bf0a-40f4-abb1-9db510fa6b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:53.531139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:53.578621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1384/2799] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:53.592532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e94d71-eee6-4840-8731-b279960c96b2 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.592887 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e94d71-eee6-4840-8731-b279960c96b2 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.593186 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e94d71-eee6-4840-8731-b279960c96b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.614432 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-86e94d71-eee6-4840-8731-b279960c96b2 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:53.615667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-86e94d71-eee6-4840-8731-b279960c96b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:53.624243 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1416/2800] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:53.628533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c6fa4-bf0a-40f4-abb1-9db510fa6b6f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:53.638719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c6fa4-bf0a-40f4-abb1-9db510fa6b6f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:53.644252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:53.644904 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.645255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.645534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.646313 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:51:53.646624 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:53.648245 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:53.660625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1385/2801] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:51:53.665623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e94d71-eee6-4840-8731-b279960c96b2 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:53.675329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e94d71-eee6-4840-8731-b279960c96b2 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:53.681823 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56b581-f9af-48e0-9170-7a1403c9c71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:53.682512 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56b581-f9af-48e0-9170-7a1403c9c71b admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.682797 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56b581-f9af-48e0-9170-7a1403c9c71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.683076 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56b581-f9af-48e0-9170-7a1403c9c71b admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.683774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56b581-f9af-48e0-9170-7a1403c9c71b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:53.685688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56b581-f9af-48e0-9170-7a1403c9c71b admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:53.723493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1417/2802] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:53 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:53.728436 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:53.742223 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591869-b9f1-4b67-867b-5b64de594e35 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:53.802444 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa68eb8-cb22-4178-b2b2-ad530a6c4577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:53.803118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68eb8-cb22-4178-b2b2-ad530a6c4577 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.803399 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68eb8-cb22-4178-b2b2-ad530a6c4577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.803674 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa68eb8-cb22-4178-b2b2-ad530a6c4577 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.804377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa68eb8-cb22-4178-b2b2-ad530a6c4577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:53.806556 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa68eb8-cb22-4178-b2b2-ad530a6c4577 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:53.831526 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1386/2803] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:53 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:53.832847 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56b581-f9af-48e0-9170-7a1403c9c71b admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:53.844622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56b581-f9af-48e0-9170-7a1403c9c71b admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:53.850494 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c1551-ec8f-4a0d-8c65-294d87e4eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:53.851159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1551-ec8f-4a0d-8c65-294d87e4eab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.851445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1551-ec8f-4a0d-8c65-294d87e4eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.851726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1551-ec8f-4a0d-8c65-294d87e4eab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.852467 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c1551-ec8f-4a0d-8c65-294d87e4eab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:53.854121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c1551-ec8f-4a0d-8c65-294d87e4eab8 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:53.865374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1418/2804] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:53.870152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa68eb8-cb22-4178-b2b2-ad530a6c4577 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:53.884596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa68eb8-cb22-4178-b2b2-ad530a6c4577 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:53.893155 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6d0c4-f6ee-45e3-a9ba-e460bd84b61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:53.894156 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6d0c4-f6ee-45e3-a9ba-e460bd84b61a admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.894533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6d0c4-f6ee-45e3-a9ba-e460bd84b61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.894912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6d0c4-f6ee-45e3-a9ba-e460bd84b61a admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.895781 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6d0c4-f6ee-45e3-a9ba-e460bd84b61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:53.897515 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6d0c4-f6ee-45e3-a9ba-e460bd84b61a admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:53.908843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1387/2805] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:53.913139 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c1551-ec8f-4a0d-8c65-294d87e4eab8 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:53.926282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c1551-ec8f-4a0d-8c65-294d87e4eab8 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:53.931166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606c67a-2977-4d7d-9c5e-01bff46c4b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:53.932093 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606c67a-2977-4d7d-9c5e-01bff46c4b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:53.932371 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606c67a-2977-4d7d-9c5e-01bff46c4b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:53.932645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606c67a-2977-4d7d-9c5e-01bff46c4b89 admin admin] PATH_INFO: `/v3/projects/2489d7a000b6493abb433a53fdf796d9/users/067869ee4f044a78a4c1e3725c6134bc/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:53.948634 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606c67a-2977-4d7d-9c5e-01bff46c4b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2489d7a000b6493abb433a53fdf796d9, user_id=067869ee4f044a78a4c1e3725c6134bc, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:53.951962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606c67a-2977-4d7d-9c5e-01bff46c4b89 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:53.968716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1419/2806] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:53 2022] PUT /identity/v3/projects/2489d7a000b6493abb433a53fdf796d9/users/067869ee4f044a78a4c1e3725c6134bc/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:54.042316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355139-d023-44a4-94b0-affdb654ded8 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.042555 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355139-d023-44a4-94b0-affdb654ded8 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.042838 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc355139-d023-44a4-94b0-affdb654ded8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.074692 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-cc355139-d023-44a4-94b0-affdb654ded8 None None] MFA Rules not processed for user `067869ee4f044a78a4c1e3725c6134bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:54.076131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cc355139-d023-44a4-94b0-affdb654ded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:54.143843 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1388/2807] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:54.148654 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606c67a-2977-4d7d-9c5e-01bff46c4b89 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.170985 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:54.215699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606c67a-2977-4d7d-9c5e-01bff46c4b89 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.221053 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd7069-721a-45f6-a7a4-8d6cf2f6370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.221843 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd7069-721a-45f6-a7a4-8d6cf2f6370c admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.222155 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd7069-721a-45f6-a7a4-8d6cf2f6370c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.222480 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd7069-721a-45f6-a7a4-8d6cf2f6370c admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.223302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd7069-721a-45f6-a7a4-8d6cf2f6370c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.225267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd7069-721a-45f6-a7a4-8d6cf2f6370c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.254404 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1420/2808] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:54 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:54.258551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355139-d023-44a4-94b0-affdb654ded8 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.269664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc355139-d023-44a4-94b0-affdb654ded8 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.283337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:54.330512 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc79bf-b30a-479b-a5e1-69829d9ab33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.331196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc79bf-b30a-479b-a5e1-69829d9ab33c admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.331480 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc79bf-b30a-479b-a5e1-69829d9ab33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.331758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc79bf-b30a-479b-a5e1-69829d9ab33c admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.332449 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc79bf-b30a-479b-a5e1-69829d9ab33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.334614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc79bf-b30a-479b-a5e1-69829d9ab33c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.357839 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1389/2809] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:54 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:54.364289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd7069-721a-45f6-a7a4-8d6cf2f6370c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.377940 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd7069-721a-45f6-a7a4-8d6cf2f6370c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.384040 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786a271-413d-4753-b5e0-d26ade633a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.384711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a271-413d-4753-b5e0-d26ade633a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.384993 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a271-413d-4753-b5e0-d26ade633a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.385268 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a271-413d-4753-b5e0-d26ade633a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.386038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786a271-413d-4753-b5e0-d26ade633a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.387651 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786a271-413d-4753-b5e0-d26ade633a65 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.399781 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1421/2810] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:54.404746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc79bf-b30a-479b-a5e1-69829d9ab33c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.415967 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc79bf-b30a-479b-a5e1-69829d9ab33c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.421668 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043d7b0-7459-4c80-bbdc-ef9a2a882272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.422505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043d7b0-7459-4c80-bbdc-ef9a2a882272 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.422786 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043d7b0-7459-4c80-bbdc-ef9a2a882272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.423078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043d7b0-7459-4c80-bbdc-ef9a2a882272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.424190 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043d7b0-7459-4c80-bbdc-ef9a2a882272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.426734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043d7b0-7459-4c80-bbdc-ef9a2a882272 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.437976 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1390/2811] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:54.442616 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786a271-413d-4753-b5e0-d26ade633a65 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.453815 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786a271-413d-4753-b5e0-d26ade633a65 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.458861 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd57ff-5304-48c7-ac19-f0b7f27a011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.459755 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd57ff-5304-48c7-ac19-f0b7f27a011a admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.460045 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd57ff-5304-48c7-ac19-f0b7f27a011a admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.460436 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd57ff-5304-48c7-ac19-f0b7f27a011a admin admin] PATH_INFO: `/v3/projects/431c5ebeb99b4d698938203887e244cd/users/9899025733c3472a923c2af186e10f93/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.476551 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd57ff-5304-48c7-ac19-f0b7f27a011a admin admin] RBAC: Authorizing `identity:create_grant(project_id=431c5ebeb99b4d698938203887e244cd, user_id=9899025733c3472a923c2af186e10f93, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.479276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd57ff-5304-48c7-ac19-f0b7f27a011a admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.495124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1422/2812] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:54 2022] PUT /identity/v3/projects/431c5ebeb99b4d698938203887e244cd/users/9899025733c3472a923c2af186e10f93/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:54.506541 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91f091-1eab-4d0c-b491-dfe36bcbf787 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.506858 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91f091-1eab-4d0c-b491-dfe36bcbf787 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.507138 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d91f091-1eab-4d0c-b491-dfe36bcbf787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.534128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-0d91f091-1eab-4d0c-b491-dfe36bcbf787 None None] MFA Rules not processed for user `9899025733c3472a923c2af186e10f93`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:54.535350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-0d91f091-1eab-4d0c-b491-dfe36bcbf787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:54.603587 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1391/2813] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:51:54.608588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd57ff-5304-48c7-ac19-f0b7f27a011a admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.672401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd57ff-5304-48c7-ac19-f0b7f27a011a admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.677552 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5a39f-fe14-4e28-827e-439ccde7ac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.678256 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a39f-fe14-4e28-827e-439ccde7ac7f admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.678531 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a39f-fe14-4e28-827e-439ccde7ac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.678801 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a39f-fe14-4e28-827e-439ccde7ac7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.679484 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5a39f-fe14-4e28-827e-439ccde7ac7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.681418 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5a39f-fe14-4e28-827e-439ccde7ac7f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.711830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1423/2814] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:51:54 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:54.716015 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91f091-1eab-4d0c-b491-dfe36bcbf787 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.728820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d91f091-1eab-4d0c-b491-dfe36bcbf787 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.790172 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7dc40-de07-4cea-86c2-b33943f765d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.790826 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7dc40-de07-4cea-86c2-b33943f765d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.791208 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7dc40-de07-4cea-86c2-b33943f765d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.791496 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7dc40-de07-4cea-86c2-b33943f765d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.792198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7dc40-de07-4cea-86c2-b33943f765d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.794132 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed7dc40-de07-4cea-86c2-b33943f765d8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.822271 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1392/2815] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:51:54 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:51:54.826399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5a39f-fe14-4e28-827e-439ccde7ac7f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.839979 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5a39f-fe14-4e28-827e-439ccde7ac7f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.844645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8eb9d-428e-4a25-b047-61ada97997ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.845323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8eb9d-428e-4a25-b047-61ada97997ac admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.845606 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8eb9d-428e-4a25-b047-61ada97997ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.845883 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8eb9d-428e-4a25-b047-61ada97997ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.846664 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8eb9d-428e-4a25-b047-61ada97997ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.848312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8eb9d-428e-4a25-b047-61ada97997ac admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.859973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1424/2816] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:54.865058 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7dc40-de07-4cea-86c2-b33943f765d8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.881287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7dc40-de07-4cea-86c2-b33943f765d8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.887412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40066db-535f-4024-8076-d14048f590f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:54.888337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40066db-535f-4024-8076-d14048f590f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:54.888621 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40066db-535f-4024-8076-d14048f590f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:54.888898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40066db-535f-4024-8076-d14048f590f9 admin admin] PATH_INFO: `/v3/projects/0e51ee071ff0485c9a46a35fe32f9459/users/87a447f57b9d4226aa15adbecd9f5226/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:54.902122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:54.905915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40066db-535f-4024-8076-d14048f590f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e51ee071ff0485c9a46a35fe32f9459, user_id=87a447f57b9d4226aa15adbecd9f5226, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:54.908705 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40066db-535f-4024-8076-d14048f590f9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:54.923471 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1393/2817] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:54 2022] PUT /identity/v3/projects/0e51ee071ff0485c9a46a35fe32f9459/users/87a447f57b9d4226aa15adbecd9f5226/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:54.927672 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8eb9d-428e-4a25-b047-61ada97997ac admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:54.938258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8eb9d-428e-4a25-b047-61ada97997ac admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:54.982642 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:51:55.003202 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b6f598-2848-47c4-b390-9ce4a5c3085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:55.003873 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6f598-2848-47c4-b390-9ce4a5c3085f admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:55.004158 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6f598-2848-47c4-b390-9ce4a5c3085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:55.004529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b6f598-2848-47c4-b390-9ce4a5c3085f admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:55.005269 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6f598-2848-47c4-b390-9ce4a5c3085f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:55.006897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b6f598-2848-47c4-b390-9ce4a5c3085f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:55.016786 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1425/2818] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:51:55.022803 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40066db-535f-4024-8076-d14048f590f9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:55.033572 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40066db-535f-4024-8076-d14048f590f9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:55.038601 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:55.039483 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:55.039763 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:55.040032 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] PATH_INFO: `/v3/projects/0e51ee071ff0485c9a46a35fe32f9459/users/87a447f57b9d4226aa15adbecd9f5226/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:55.042174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e51ee071ff0485c9a46a35fe32f9459, user_id=87a447f57b9d4226aa15adbecd9f5226, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:55.044821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:55.055240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1394/2819] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:51:55 2022] PUT /identity/v3/projects/0e51ee071ff0485c9a46a35fe32f9459/users/87a447f57b9d4226aa15adbecd9f5226/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:51:55.067210 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa12d5-701e-4ebd-82f9-6655f3159c36 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:55.067493 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa12d5-701e-4ebd-82f9-6655f3159c36 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:55.067772 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa12d5-701e-4ebd-82f9-6655f3159c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:55.093787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-f3fa12d5-701e-4ebd-82f9-6655f3159c36 None None] MFA Rules not processed for user `87a447f57b9d4226aa15adbecd9f5226`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:51:55.095091 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-f3fa12d5-701e-4ebd-82f9-6655f3159c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:55.174860 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1426/2820] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:51:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:51:55.187261 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:51:55.189546 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:51:55.252451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937fb7a-7907-4945-a71b-d2d5b6803839 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:51:55.257320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:51:55.257975 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:51:55.258292 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:51:55.258566 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:51:55.317512 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:51:55.318969 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:51:55.328020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1395/2821] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:51:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:00.500129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddfff4-a041-4bc8-a6be-71448b015353 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:00.500647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddfff4-a041-4bc8-a6be-71448b015353 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:00.500647 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddfff4-a041-4bc8-a6be-71448b015353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:00.521711 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-55ddfff4-a041-4bc8-a6be-71448b015353 None None] MFA Rules not processed for user `9273538810d24fe19acf7c8e190e6dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:00.522976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-55ddfff4-a041-4bc8-a6be-71448b015353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:00.584798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1427/2822] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:52:00.828440 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:00.830328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:00.902806 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3797b28-d527-444c-ac72-946f9a868543 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:00.907714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:00.908371 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:00.908657 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:00.908935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:00.911090 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:00.922757 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:00.924252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:00.932658 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1396/2823] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:01.076335 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddfff4-a041-4bc8-a6be-71448b015353 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:01.077929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-55ddfff4-a041-4bc8-a6be-71448b015353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:01.095329 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddfff4-a041-4bc8-a6be-71448b015353 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:01.099178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:01.099951 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:01.100267 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:01.100613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:01.167440 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:01.169121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:01.181459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1428/2824] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:01.769104 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:01.779179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3241e2-9eaa-42a5-91a4-69bdff2ed512 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:01.783100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175333db-9ce1-41c7-8d74-b09c577b4397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:01.783823 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175333db-9ce1-41c7-8d74-b09c577b4397 service cinder] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:01.784128 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175333db-9ce1-41c7-8d74-b09c577b4397 service cinder] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:01.784322 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175333db-9ce1-41c7-8d74-b09c577b4397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:01.796730 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175333db-9ce1-41c7-8d74-b09c577b4397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:01.798224 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175333db-9ce1-41c7-8d74-b09c577b4397 service cinder] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:01.808347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1397/2825] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:02.084351 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:02.086043 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:02.102496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:02.201592 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e0fb6-002a-4d50-88f5-e6aab150bc23 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:02.208453 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd713596-b976-49a9-8627-92d8e9b954c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:02.209681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd713596-b976-49a9-8627-92d8e9b954c8 service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:02.209681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd713596-b976-49a9-8627-92d8e9b954c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:02.209681 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd713596-b976-49a9-8627-92d8e9b954c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:02.212137 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bd713596-b976-49a9-8627-92d8e9b954c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:02.225650 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd713596-b976-49a9-8627-92d8e9b954c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:02.227392 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd713596-b976-49a9-8627-92d8e9b954c8 service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:02.238888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1429/2826] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:05.723960 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175333db-9ce1-41c7-8d74-b09c577b4397 service cinder] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:05.750430 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:05.791006 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175333db-9ce1-41c7-8d74-b09c577b4397 service cinder] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:05.798970 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:05.800498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:05.800981 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:05.801361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] PATH_INFO: `/v3/users/067869ee4f044a78a4c1e3725c6134bc` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:05.802827 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=067869ee4f044a78a4c1e3725c6134bc)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:05.804746 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:05.858605 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067869ee4f044a78a4c1e3725c6134bc'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:05.859273 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067869ee4f044a78a4c1e3725c6134bc'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:05.868117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067869ee4f044a78a4c1e3725c6134bc'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:05.875551 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067869ee4f044a78a4c1e3725c6134bc'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:05.888143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067869ee4f044a78a4c1e3725c6134bc'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:05.894279 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1398/2827] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:52:05 2022] DELETE /identity/v3/users/067869ee4f044a78a4c1e3725c6134bc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:05.898981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c2e1f-80e5-499c-9269-c5d4194f4b72 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:05.899563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c2e1f-80e5-499c-9269-c5d4194f4b72 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:05.899563 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c2e1f-80e5-499c-9269-c5d4194f4b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:05.919035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b10c2e1f-80e5-499c-9269-c5d4194f4b72 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:05.920263 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b10c2e1f-80e5-499c-9269-c5d4194f4b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:05.994614 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1430/2828] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:52:06.004497 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:06.006251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:06.075204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdc5f3-d169-47a0-8e4e-7f7bce8d5588 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:06.079542 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8f540-3635-446c-9d83-5de5f2f2516c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:06.080197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f540-3635-446c-9d83-5de5f2f2516c service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:06.080481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f540-3635-446c-9d83-5de5f2f2516c service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:06.080745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f540-3635-446c-9d83-5de5f2f2516c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:06.090387 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8f540-3635-446c-9d83-5de5f2f2516c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:06.091830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8f540-3635-446c-9d83-5de5f2f2516c service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:06.101697 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1399/2829] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:06.376044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c2e1f-80e5-499c-9269-c5d4194f4b72 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:06.377676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b10c2e1f-80e5-499c-9269-c5d4194f4b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:06.393515 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c2e1f-80e5-499c-9269-c5d4194f4b72 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:06.407264 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:06.408161 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:06.408448 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:06.408726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] PATH_INFO: `/v3/projects/2489d7a000b6493abb433a53fdf796d9` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:06.410701 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2489d7a000b6493abb433a53fdf796d9)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:06.412621 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:06.463541 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2489d7a000b6493abb433a53fdf796d9', 'request_id': 'req-0a50b93b-4c8e-4fda-976e-b94a49c9c816'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.472390 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2489d7a000b6493abb433a53fdf796d9', 'request_id': 'req-0a50b93b-4c8e-4fda-976e-b94a49c9c816'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.477806 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2489d7a000b6493abb433a53fdf796d9', 'request_id': 'req-0a50b93b-4c8e-4fda-976e-b94a49c9c816'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.488709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] The token cache is being invalidate because project 2489d7a000b6493abb433a53fdf796d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:52:06.488995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.489603 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.491185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1431/2830] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:52:06 2022] DELETE /identity/v3/projects/2489d7a000b6493abb433a53fdf796d9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:06.495211 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8f540-3635-446c-9d83-5de5f2f2516c service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:06.505253 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8f540-3635-446c-9d83-5de5f2f2516c service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:06.548664 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:06.566586 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:06.567474 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:06.567752 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:06.568020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] PATH_INFO: `/v3/users/9899025733c3472a923c2af186e10f93` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:06.569289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9899025733c3472a923c2af186e10f93)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:06.571257 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:06.625079 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9899025733c3472a923c2af186e10f93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.625798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9899025733c3472a923c2af186e10f93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.643743 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9899025733c3472a923c2af186e10f93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.651481 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9899025733c3472a923c2af186e10f93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.663248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9899025733c3472a923c2af186e10f93'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:06.669604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1400/2831] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:52:06 2022] DELETE /identity/v3/users/9899025733c3472a923c2af186e10f93 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:06.958524 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:06.960036 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:06.968435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:06.974262 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b93b-4c8e-4fda-976e-b94a49c9c816 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:07.035908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:07.036700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:07.036981 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:07.037261 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] PATH_INFO: `/v3/projects/431c5ebeb99b4d698938203887e244cd` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:07.038513 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431c5ebeb99b4d698938203887e244cd)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:07.040419 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:07.089777 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431c5ebeb99b4d698938203887e244cd', 'request_id': 'req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.097689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431c5ebeb99b4d698938203887e244cd', 'request_id': 'req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.103601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431c5ebeb99b4d698938203887e244cd', 'request_id': 'req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.115342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] The token cache is being invalidate because project 431c5ebeb99b4d698938203887e244cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:52:07.115623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.116308 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.117875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1432/2832] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:52:06 2022] DELETE /identity/v3/projects/431c5ebeb99b4d698938203887e244cd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:07.122213 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:07.123734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:07.136606 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fdab-a425-481c-85e9-55fcb916e4ba admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:07.194364 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:07.195254 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:07.195534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:07.195811 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] PATH_INFO: `/v3/users/87a447f57b9d4226aa15adbecd9f5226` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:07.197025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a447f57b9d4226aa15adbecd9f5226)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:07.199017 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:07.251890 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a447f57b9d4226aa15adbecd9f5226'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.252575 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a447f57b9d4226aa15adbecd9f5226'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.261180 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a447f57b9d4226aa15adbecd9f5226'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.268348 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a447f57b9d4226aa15adbecd9f5226'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.270599 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:07.284867 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-71b7d728-b324-4355-90d8-01b8c54c6d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a447f57b9d4226aa15adbecd9f5226'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.291143 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1401/2833] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:52:07 2022] DELETE /identity/v3/users/87a447f57b9d4226aa15adbecd9f5226 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:07.579271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:07.580784 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:07.594393 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1243a-95c7-4a6b-94f6-9559d3f50ac7 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:07.655444 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:07.656341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:07.656623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:07.656869 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] PATH_INFO: `/v3/projects/0e51ee071ff0485c9a46a35fe32f9459` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:07.658212 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e51ee071ff0485c9a46a35fe32f9459)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:07.660126 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:07.707121 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:07.720830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e51ee071ff0485c9a46a35fe32f9459', 'request_id': 'req-311a0d80-54fe-4199-bde2-0fb0c758e395'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.730914 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e51ee071ff0485c9a46a35fe32f9459', 'request_id': 'req-311a0d80-54fe-4199-bde2-0fb0c758e395'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.739200 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e51ee071ff0485c9a46a35fe32f9459', 'request_id': 'req-311a0d80-54fe-4199-bde2-0fb0c758e395'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.751405 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] The token cache is being invalidate because project 0e51ee071ff0485c9a46a35fe32f9459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:52:07.751678 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.752369 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-311a0d80-54fe-4199-bde2-0fb0c758e395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:07.754005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1433/2834] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:52:07 2022] DELETE /identity/v3/projects/0e51ee071ff0485c9a46a35fe32f9459 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:07.759375 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acf21-cb62-4a03-9137-817aaaf112e9 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:07.759663 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acf21-cb62-4a03-9137-817aaaf112e9 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:07.759962 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9acf21-cb62-4a03-9137-817aaaf112e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:07.779630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-fa9acf21-cb62-4a03-9137-817aaaf112e9 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:07.780825 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-fa9acf21-cb62-4a03-9137-817aaaf112e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:07.850699 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1402/2835] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:52:07.858696 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4794f0-b64f-4e08-b28e-c81981fbd6b0 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:07.858983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4794f0-b64f-4e08-b28e-c81981fbd6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:07.859260 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4794f0-b64f-4e08-b28e-c81981fbd6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:07.878556 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-ed4794f0-b64f-4e08-b28e-c81981fbd6b0 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:07.879758 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ed4794f0-b64f-4e08-b28e-c81981fbd6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:07.888074 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1434/2836] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:52:07.892441 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9acf21-cb62-4a03-9137-817aaaf112e9 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:07.902590 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9acf21-cb62-4a03-9137-817aaaf112e9 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:07.908131 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:07.908792 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:07.909072 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:07.909340 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:07.910110 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:52:07.910412 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:07.912025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:07.923980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1403/2837] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:52:07.928413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4794f0-b64f-4e08-b28e-c81981fbd6b0 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:07.937757 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4794f0-b64f-4e08-b28e-c81981fbd6b0 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:07.942925 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ee5db-aa55-46ce-9890-651bde98fdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:07.943566 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ee5db-aa55-46ce-9890-651bde98fdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:07.943844 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ee5db-aa55-46ce-9890-651bde98fdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:07.944123 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ee5db-aa55-46ce-9890-651bde98fdb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:07.944845 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ee5db-aa55-46ce-9890-651bde98fdb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:07.946782 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ee5db-aa55-46ce-9890-651bde98fdb5 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:07.976098 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1435/2838] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:52:07 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:52:07.980248 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:07.991882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b3524-e54a-412f-96a7-4cb7dcc947b9 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:08.053389 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be08b63-074c-4244-b1c3-3da25012713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:08.054133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08b63-074c-4244-b1c3-3da25012713f admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:08.054417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08b63-074c-4244-b1c3-3da25012713f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:08.054698 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be08b63-074c-4244-b1c3-3da25012713f admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:08.055442 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be08b63-074c-4244-b1c3-3da25012713f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:08.057385 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be08b63-074c-4244-b1c3-3da25012713f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:08.081898 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1404/2839] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:52:07 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:52:08.086084 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ee5db-aa55-46ce-9890-651bde98fdb5 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:08.096900 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ee5db-aa55-46ce-9890-651bde98fdb5 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:08.102022 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae9d8-3e03-45e2-acb5-9a44b8f1393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:08.102624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae9d8-3e03-45e2-acb5-9a44b8f1393e admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:08.102878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae9d8-3e03-45e2-acb5-9a44b8f1393e admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:08.103164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae9d8-3e03-45e2-acb5-9a44b8f1393e admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:08.103900 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae9d8-3e03-45e2-acb5-9a44b8f1393e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:08.105581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae9d8-3e03-45e2-acb5-9a44b8f1393e admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:08.120402 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1436/2840] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:52:08.124887 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be08b63-074c-4244-b1c3-3da25012713f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:08.134888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be08b63-074c-4244-b1c3-3da25012713f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:08.139869 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02520cfb-da4f-4a19-b423-aea7e718634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:08.140533 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520cfb-da4f-4a19-b423-aea7e718634d admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:08.140894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520cfb-da4f-4a19-b423-aea7e718634d admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:08.141086 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02520cfb-da4f-4a19-b423-aea7e718634d admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:08.141837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520cfb-da4f-4a19-b423-aea7e718634d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:08.143506 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02520cfb-da4f-4a19-b423-aea7e718634d admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:08.154931 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1405/2841] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:52:08.159124 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae9d8-3e03-45e2-acb5-9a44b8f1393e admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:08.169787 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae9d8-3e03-45e2-acb5-9a44b8f1393e admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:08.175454 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:08.176349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:08.176631 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:08.176907 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] PATH_INFO: `/v3/projects/b0cea6fd9c8b465a862b8cf334a4335c/users/5524d84deeb747038a220e64b3c9bf34/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:08.192341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cea6fd9c8b465a862b8cf334a4335c, user_id=5524d84deeb747038a220e64b3c9bf34, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:08.195147 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:08.212282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1437/2842] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:52:08 2022] PUT /identity/v3/projects/b0cea6fd9c8b465a862b8cf334a4335c/users/5524d84deeb747038a220e64b3c9bf34/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:08.217703 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6513-4193-426a-809b-97d6aae0323f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:08.218059 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6513-4193-426a-809b-97d6aae0323f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:08.218338 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf6513-4193-426a-809b-97d6aae0323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:08.238854 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-b4cf6513-4193-426a-809b-97d6aae0323f None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:08.240057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b4cf6513-4193-426a-809b-97d6aae0323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:08.285020 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:08.302160 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1406/2843] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:52:08.311939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:08.313908 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:08.375607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d0a9-6089-419c-9fc8-1bff78bf367c admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:08.379667 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:08.380322 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:08.380601 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:08.380875 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:08.393741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:08.395218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:08.404853 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1438/2844] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:52:12.508693 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea70778-2f95-4e6f-ad56-6e95b218a323 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:12.509249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea70778-2f95-4e6f-ad56-6e95b218a323 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:12.509249 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea70778-2f95-4e6f-ad56-6e95b218a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:12.537808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-cea70778-2f95-4e6f-ad56-6e95b218a323 None None] MFA Rules not processed for user `5524d84deeb747038a220e64b3c9bf34`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:12.539152 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-cea70778-2f95-4e6f-ad56-6e95b218a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:12.609350 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:12.611587 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:12.628957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1407/2845] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:52:12.638260 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea70778-2f95-4e6f-ad56-6e95b218a323 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:12.650740 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea70778-2f95-4e6f-ad56-6e95b218a323 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:12.655407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236aeb-2694-47cd-a061-dd99485bbf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:12.656341 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236aeb-2694-47cd-a061-dd99485bbf9c admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:12.656627 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236aeb-2694-47cd-a061-dd99485bbf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:12.656908 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf236aeb-2694-47cd-a061-dd99485bbf9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:12.657614 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf236aeb-2694-47cd-a061-dd99485bbf9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:12.659701 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf236aeb-2694-47cd-a061-dd99485bbf9c admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:12.692840 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1408/2846] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:52:12 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:52:12.696926 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236aeb-2694-47cd-a061-dd99485bbf9c admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:12.702316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:12.722302 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030b16a-27f1-4ea1-b229-7b56395c5a10 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:12.775567 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf236aeb-2694-47cd-a061-dd99485bbf9c admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:12.781025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4174f2-4954-4715-840f-9469c2f18bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:12.781859 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4174f2-4954-4715-840f-9469c2f18bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:12.782179 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4174f2-4954-4715-840f-9469c2f18bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:12.782458 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4174f2-4954-4715-840f-9469c2f18bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:12.783169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4174f2-4954-4715-840f-9469c2f18bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:12.785100 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4174f2-4954-4715-840f-9469c2f18bf8 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:12.806307 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1409/2847] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:52:12 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:52:12.810056 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4174f2-4954-4715-840f-9469c2f18bf8 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:12.811827 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:12.812468 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:12.812764 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:12.813038 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:12.815816 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:12.820405 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4174f2-4954-4715-840f-9469c2f18bf8 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:12.825207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89dcc7-d05f-4617-a82f-38478422c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:12.825896 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89dcc7-d05f-4617-a82f-38478422c2da admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:12.826191 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89dcc7-d05f-4617-a82f-38478422c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:12.826466 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89dcc7-d05f-4617-a82f-38478422c2da admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:12.827196 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89dcc7-d05f-4617-a82f-38478422c2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:12.828352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:12.828794 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c89dcc7-d05f-4617-a82f-38478422c2da admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:12.830113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:12.839998 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1410/2848] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 19:52:12.841525 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1439/2849] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:12.843885 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89dcc7-d05f-4617-a82f-38478422c2da admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:12.854870 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89dcc7-d05f-4617-a82f-38478422c2da admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:12.866695 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fb20-1bd6-4296-a702-658086fe180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:12.867596 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fb20-1bd6-4296-a702-658086fe180f admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:12.868117 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fb20-1bd6-4296-a702-658086fe180f admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:12.868283 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006fb20-1bd6-4296-a702-658086fe180f admin admin] PATH_INFO: `/v3/projects/ff54ec15f2884c5cab352a9a16f54f17/users/1a4135feed754dca93f84ec9630be3cf/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:12.885402 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006fb20-1bd6-4296-a702-658086fe180f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff54ec15f2884c5cab352a9a16f54f17, user_id=1a4135feed754dca93f84ec9630be3cf, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:12.888222 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006fb20-1bd6-4296-a702-658086fe180f admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:12.904169 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1411/2850] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:52:12 2022] PUT /identity/v3/projects/ff54ec15f2884c5cab352a9a16f54f17/users/1a4135feed754dca93f84ec9630be3cf/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:12.908391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:12.919948 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ced30-5b0c-4b76-afb3-0b0e7bbd1106 service nova] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:12.986238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b15b7-c41e-4fa8-bfe7-64514c3cc558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:12.987095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b15b7-c41e-4fa8-bfe7-64514c3cc558 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:12.987529 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b15b7-c41e-4fa8-bfe7-64514c3cc558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:12.987817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b15b7-c41e-4fa8-bfe7-64514c3cc558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:12.988720 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b15b7-c41e-4fa8-bfe7-64514c3cc558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:12.991129 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b15b7-c41e-4fa8-bfe7-64514c3cc558 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:13.002713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1440/2851] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:52:13.007162 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fb20-1bd6-4296-a702-658086fe180f admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:13.017736 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006fb20-1bd6-4296-a702-658086fe180f admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:13.022636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:13.023535 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:13.023818 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:13.024096 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] PATH_INFO: `/v3/projects/ff54ec15f2884c5cab352a9a16f54f17/users/1a4135feed754dca93f84ec9630be3cf/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:13.026230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff54ec15f2884c5cab352a9a16f54f17, user_id=1a4135feed754dca93f84ec9630be3cf, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:13.029749 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:13.036230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:13.043734 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1412/2852] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:52:13 2022] PUT /identity/v3/projects/ff54ec15f2884c5cab352a9a16f54f17/users/1a4135feed754dca93f84ec9630be3cf/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:18.212553 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb350-8420-4be3-b83e-c4c01e19ba41 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:18.213134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb350-8420-4be3-b83e-c4c01e19ba41 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:18.213134 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fb350-8420-4be3-b83e-c4c01e19ba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:18.242702 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-cd8fb350-8420-4be3-b83e-c4c01e19ba41 None None] MFA Rules not processed for user `1a4135feed754dca93f84ec9630be3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:18.244039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cd8fb350-8420-4be3-b83e-c4c01e19ba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:18.315703 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1441/2853] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:52:18.329490 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:18.331498 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:18.392187 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43bc9-9609-4c1f-87fa-365219706a67 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:18.395886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca1a1889e2fb436a86c5e68bf9f1e608', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:18.396652 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:18.396935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:18.397215 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:18.463413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:18.465178 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:18.477001 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1413/2854] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:18.578414 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19bd3-1af4-449b-9c77-a3d0aa0ca11a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:18.578741 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19bd3-1af4-449b-9c77-a3d0aa0ca11a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:18.579009 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c19bd3-1af4-449b-9c77-a3d0aa0ca11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:18.588611 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=100 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:18.640532 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-b0c19bd3-1af4-449b-9c77-a3d0aa0ca11a None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:18.641888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b0c19bd3-1af4-449b-9c77-a3d0aa0ca11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:18.715336 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1442/2855] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:52:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:52:18.786316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:18.786316 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:18.877502 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93408792-17d9-43f2-945f-0d6159277a98 service glance] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:18.882417 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd2b23-547a-43cd-aab4-a6eb7030b9db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:18.883066 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd2b23-547a-43cd-aab4-a6eb7030b9db service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:18.883349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd2b23-547a-43cd-aab4-a6eb7030b9db service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:18.883625 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd2b23-547a-43cd-aab4-a6eb7030b9db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:18.891837 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd2b23-547a-43cd-aab4-a6eb7030b9db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:18.893508 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd2b23-547a-43cd-aab4-a6eb7030b9db service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:18.901934 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1414/2856] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:52:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:52:27.520761 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a5d09-ddff-4f6a-b34c-13232daf9a6a None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:27.521295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a5d09-ddff-4f6a-b34c-13232daf9a6a None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:27.521295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a5d09-ddff-4f6a-b34c-13232daf9a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:27.539462 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-256a5d09-ddff-4f6a-b34c-13232daf9a6a None None] MFA Rules not processed for user `5524d84deeb747038a220e64b3c9bf34`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:27.540660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-256a5d09-ddff-4f6a-b34c-13232daf9a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:27.547944 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1443/2857] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:52:28.898594 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=90 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:32.307358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459f8a4-863b-4b94-971f-a0d0c6b07db3 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:32.308028 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459f8a4-863b-4b94-971f-a0d0c6b07db3 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:32.308116 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459f8a4-863b-4b94-971f-a0d0c6b07db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:32.328357 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-a459f8a4-863b-4b94-971f-a0d0c6b07db3 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:32.329579 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a459f8a4-863b-4b94-971f-a0d0c6b07db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:32.337635 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1415/2858] 10.222.0.61 () {58 vars in 1009 bytes} [Fri Jul 1 19:52:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:52:32.349989 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a5d09-ddff-4f6a-b34c-13232daf9a6a None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:32.362829 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a5d09-ddff-4f6a-b34c-13232daf9a6a None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:32.368877 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8b1f5-4d63-4dd0-a44b-212909673745 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:32.369554 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b1f5-4d63-4dd0-a44b-212909673745 service swift] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:32.370057 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b1f5-4d63-4dd0-a44b-212909673745 service swift] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:32.370356 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8b1f5-4d63-4dd0-a44b-212909673745 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:32.380173 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8b1f5-4d63-4dd0-a44b-212909673745 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:32.383236 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8b1f5-4d63-4dd0-a44b-212909673745 service swift] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:32.397926 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1444/2859] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:52:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:52:34.233041 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459f8a4-863b-4b94-971f-a0d0c6b07db3 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:34.234793 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-a459f8a4-863b-4b94-971f-a0d0c6b07db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:34.314410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459f8a4-863b-4b94-971f-a0d0c6b07db3 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:34.320503 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:34.321475 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:34.321656 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:34.321935 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] PATH_INFO: `/v3/users/5124fcefa3f34db4bbdb129fce668f6c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:34.323197 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5124fcefa3f34db4bbdb129fce668f6c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:34.325207 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:34.391619 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5124fcefa3f34db4bbdb129fce668f6c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:34.392293 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5124fcefa3f34db4bbdb129fce668f6c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:34.404510 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5124fcefa3f34db4bbdb129fce668f6c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:34.414210 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5124fcefa3f34db4bbdb129fce668f6c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:34.426429 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5124fcefa3f34db4bbdb129fce668f6c'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:34.432382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1416/2860] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:52:34 2022] DELETE /identity/v3/users/5124fcefa3f34db4bbdb129fce668f6c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:52:34.436990 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f609-379a-48e3-a420-10434718a00e None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:34.437496 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f609-379a-48e3-a420-10434718a00e None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:34.437600 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f609-379a-48e3-a420-10434718a00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:34.455135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-5853f609-379a-48e3-a420-10434718a00e None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:52:34.456341 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5853f609-379a-48e3-a420-10434718a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:34.519107 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1445/2861] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:52:34.530785 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:34.532361 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:34.594360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf977-b38c-4781-9ba7-b1895c26ae86 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:34.601350 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:34.602049 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:34.602332 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:34.602604 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:34.613758 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:34.615289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:34.626919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1417/2862] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:52:34.950995 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853f609-379a-48e3-a420-10434718a00e None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:52:34.952697 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-5853f609-379a-48e3-a420-10434718a00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:52:34.964958 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853f609-379a-48e3-a420-10434718a00e None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:52:34.969669 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:52:34.970583 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:52:34.970872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:52:34.971153 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] PATH_INFO: `/v3/projects/b84b72d5e3f845de93e81c466f4eb7f9` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:52:34.972353 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84b72d5e3f845de93e81c466f4eb7f9)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:52:34.975020 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:52:35.054298 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:35.062465 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84b72d5e3f845de93e81c466f4eb7f9', 'request_id': 'req-3df911db-04ea-4ced-9a08-57bf7b29b2d7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:35.079386 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84b72d5e3f845de93e81c466f4eb7f9', 'request_id': 'req-3df911db-04ea-4ced-9a08-57bf7b29b2d7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:35.087413 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84b72d5e3f845de93e81c466f4eb7f9', 'request_id': 'req-3df911db-04ea-4ced-9a08-57bf7b29b2d7'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:35.099518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] The token cache is being invalidate because project b84b72d5e3f845de93e81c466f4eb7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:52:35.099819 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:35.100622 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:52:35.114623 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1446/2863] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:52:34 2022] DELETE /identity/v3/projects/b84b72d5e3f845de93e81c466f4eb7f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:52:44.621287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:45.096520 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:13.177807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:13.179571 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:13.193410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843a136-4259-4a56-9b6e-3faa6a32b067 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:13.244004 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:13.244650 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:13.244927 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:13.245198 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:13.247251 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:13.310377 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:13.311752 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:13.321714 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1418/2864] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:53:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:53:22.633292 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:22.634888 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:22.703774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df911db-04ea-4ced-9a08-57bf7b29b2d7 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:22.708892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:22.709780 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:22.710077 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:22.710344 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] PATH_INFO: `/v3/users/9273538810d24fe19acf7c8e190e6dfe` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:22.711666 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9273538810d24fe19acf7c8e190e6dfe)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:22.713660 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:22.763565 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9273538810d24fe19acf7c8e190e6dfe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:22.772396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9273538810d24fe19acf7c8e190e6dfe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:22.773095 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9273538810d24fe19acf7c8e190e6dfe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:22.780420 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9273538810d24fe19acf7c8e190e6dfe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:22.793035 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-4562f334-87e0-46c7-81a9-4b85c75ea552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9273538810d24fe19acf7c8e190e6dfe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:22.799237 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1447/2865] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:53:22 2022] DELETE /identity/v3/users/9273538810d24fe19acf7c8e190e6dfe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:53:23.255849 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:23.267882 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cd7ba-c961-4737-ba81-b0e259cb1762 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:23.329563 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:23.330487 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.330768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.331044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] PATH_INFO: `/v3/projects/d13ae3749c0f4f9e80ae0403b41d6b4c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.332252 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d13ae3749c0f4f9e80ae0403b41d6b4c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:23.334184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:23.384610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'request_id': 'req-9e5c19e3-ef23-4124-9614-79f75aab1181'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:23.387105 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:23.394137 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'request_id': 'req-9e5c19e3-ef23-4124-9614-79f75aab1181'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:23.400726 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd13ae3749c0f4f9e80ae0403b41d6b4c', 'request_id': 'req-9e5c19e3-ef23-4124-9614-79f75aab1181'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:23.412330 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] The token cache is being invalidate because project d13ae3749c0f4f9e80ae0403b41d6b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:53:23.412620 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:23.413386 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-9e5c19e3-ef23-4124-9614-79f75aab1181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:53:23.415150 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1419/2866] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:53:23 2022] DELETE /identity/v3/projects/d13ae3749c0f4f9e80ae0403b41d6b4c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:53:23.421620 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c5ef-22e6-4889-b19c-36cc346378b1 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.421933 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c5ef-22e6-4889-b19c-36cc346378b1 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.422253 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85c5ef-22e6-4889-b19c-36cc346378b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.443831 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-df85c5ef-22e6-4889-b19c-36cc346378b1 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:53:23.445588 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-df85c5ef-22e6-4889-b19c-36cc346378b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:23.514361 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1448/2867] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:53:23.522451 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430a16-6713-4191-8464-ff4082e52826 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.522741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430a16-6713-4191-8464-ff4082e52826 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.523023 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff430a16-6713-4191-8464-ff4082e52826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.543940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-ff430a16-6713-4191-8464-ff4082e52826 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:53:23.546094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-ff430a16-6713-4191-8464-ff4082e52826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:23.555082 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1420/2868] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 19:53:23.560619 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85c5ef-22e6-4889-b19c-36cc346378b1 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:23.570774 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85c5ef-22e6-4889-b19c-36cc346378b1 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:23.575491 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:23.576151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.576435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.576715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] PATH_INFO: `/v3/domains` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.577459 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80243) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 19:53:23.577767 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:23.579439 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:23.591188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1449/2869] 10.222.0.61 () {58 vars in 1152 bytes} [Fri Jul 1 19:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 19:53:23.595504 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430a16-6713-4191-8464-ff4082e52826 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:23.605206 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff430a16-6713-4191-8464-ff4082e52826 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:23.610435 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9c23-7f5c-444e-96b5-7c2fb6a9b436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:23.611095 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9c23-7f5c-444e-96b5-7c2fb6a9b436 admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.611372 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9c23-7f5c-444e-96b5-7c2fb6a9b436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.611631 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9c23-7f5c-444e-96b5-7c2fb6a9b436 admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.612333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db9c23-7f5c-444e-96b5-7c2fb6a9b436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:23.614320 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db9c23-7f5c-444e-96b5-7c2fb6a9b436 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:23.642084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1421/2870] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:53:23 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:53:23.646289 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:23.656983 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cd28a-bfa3-4cd5-a3e7-a9bdcbfb766f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:23.661052 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:23.718293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcd82f-2984-4afb-8740-c962b5b3920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:23.719004 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcd82f-2984-4afb-8740-c962b5b3920f admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.719293 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcd82f-2984-4afb-8740-c962b5b3920f admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.719575 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dcd82f-2984-4afb-8740-c962b5b3920f admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.720277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcd82f-2984-4afb-8740-c962b5b3920f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:23.722280 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dcd82f-2984-4afb-8740-c962b5b3920f admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:23.743578 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1450/2871] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:53:23 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:53:23.747857 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9c23-7f5c-444e-96b5-7c2fb6a9b436 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:23.758493 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9c23-7f5c-444e-96b5-7c2fb6a9b436 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:23.763255 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f1c90-d310-494f-b017-b46b38d6f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:23.763915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1c90-d310-494f-b017-b46b38d6f3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.764204 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1c90-d310-494f-b017-b46b38d6f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.764547 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f1c90-d310-494f-b017-b46b38d6f3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.765244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1c90-d310-494f-b017-b46b38d6f3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:23.766899 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f1c90-d310-494f-b017-b46b38d6f3d1 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:23.777450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1422/2872] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:53:23.781450 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcd82f-2984-4afb-8740-c962b5b3920f admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:23.792071 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dcd82f-2984-4afb-8740-c962b5b3920f admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:23.797612 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e61696-d65b-4136-af7c-4522c4bcb893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:23.798323 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61696-d65b-4136-af7c-4522c4bcb893 admin admin] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.798608 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61696-d65b-4136-af7c-4522c4bcb893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.798859 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e61696-d65b-4136-af7c-4522c4bcb893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.799595 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e61696-d65b-4136-af7c-4522c4bcb893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:23.801218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e61696-d65b-4136-af7c-4522c4bcb893 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:23.811688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1451/2873] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:53:23.816118 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f1c90-d310-494f-b017-b46b38d6f3d1 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:23.826559 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f1c90-d310-494f-b017-b46b38d6f3d1 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:23.831583 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:23.832540 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] REQUEST_METHOD: `PUT` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.832817 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.833088 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] PATH_INFO: `/v3/projects/dd20b488413a476aa45ee9c6d3ffbf70/users/5a38bc1705a64785aaac2b561159fa26/roles/1cafdd847d454019a89ce61428b4a863` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.847807 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd20b488413a476aa45ee9c6d3ffbf70, user_id=5a38bc1705a64785aaac2b561159fa26, role_id=1cafdd847d454019a89ce61428b4a863)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:23.850484 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:23.868938 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1423/2874] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:53:23 2022] PUT /identity/v3/projects/dd20b488413a476aa45ee9c6d3ffbf70/users/5a38bc1705a64785aaac2b561159fa26/roles/1cafdd847d454019a89ce61428b4a863 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:53:23.874389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf710-2485-4a46-a5fa-15894e7d3a98 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:23.874677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf710-2485-4a46-a5fa-15894e7d3a98 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:23.874957 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdf710-2485-4a46-a5fa-15894e7d3a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:23.892897 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-bffdf710-2485-4a46-a5fa-15894e7d3a98 None None] MFA Rules not processed for user `6b9038df7e244837aceca33ded6cf0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:53:23.894509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-bffdf710-2485-4a46-a5fa-15894e7d3a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:23.971062 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1452/2875] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:53:23.981149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:23.983327 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:24.043505 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d57a6-d75d-4372-a0ce-24b33cac1afa admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:24.047528 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1443f-8190-4720-8f7e-ae0881f536ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:24.048174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1443f-8190-4720-8f7e-ae0881f536ed service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:24.048450 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1443f-8190-4720-8f7e-ae0881f536ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:24.048719 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1443f-8190-4720-8f7e-ae0881f536ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:24.058971 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1443f-8190-4720-8f7e-ae0881f536ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:24.060419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1443f-8190-4720-8f7e-ae0881f536ed service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:24.070964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1424/2876] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:53:28.067542 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13e3f-3cfe-47d9-959c-2bfc10d27e5d None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:28.068030 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13e3f-3cfe-47d9-959c-2bfc10d27e5d None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:28.068157 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f13e3f-3cfe-47d9-959c-2bfc10d27e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:28.098286 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-68f13e3f-3cfe-47d9-959c-2bfc10d27e5d None None] MFA Rules not processed for user `5a38bc1705a64785aaac2b561159fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:53:28.099424 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-68f13e3f-3cfe-47d9-959c-2bfc10d27e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:28.167641 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1453/2877] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:53:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:53:28.171915 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1443f-8190-4720-8f7e-ae0881f536ed service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:28.182762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1443f-8190-4720-8f7e-ae0881f536ed service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:28.187712 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b158e-551e-4718-be97-b2f2b21019ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:28.188388 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b158e-551e-4718-be97-b2f2b21019ef admin admin] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:28.189000 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b158e-551e-4718-be97-b2f2b21019ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:28.189289 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b158e-551e-4718-be97-b2f2b21019ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:28.190046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b158e-551e-4718-be97-b2f2b21019ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:28.191991 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b158e-551e-4718-be97-b2f2b21019ef admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:28.221240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1425/2878] 10.222.0.61 () {60 vars in 1152 bytes} [Fri Jul 1 19:53:28 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 19:53:28.225506 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13e3f-3cfe-47d9-959c-2bfc10d27e5d None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:28.236699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f13e3f-3cfe-47d9-959c-2bfc10d27e5d None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:28.248597 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:28.303818 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a76d8-8bb9-485a-9a9a-2eb741d850a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:28.304517 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a76d8-8bb9-485a-9a9a-2eb741d850a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:28.304803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a76d8-8bb9-485a-9a9a-2eb741d850a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:28.305166 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a76d8-8bb9-485a-9a9a-2eb741d850a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:28.305893 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a76d8-8bb9-485a-9a9a-2eb741d850a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:28.307923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a76d8-8bb9-485a-9a9a-2eb741d850a8 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:28.330307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1454/2879] 10.222.0.61 () {60 vars in 1143 bytes} [Fri Jul 1 19:53:28 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 19:53:28.334337 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b158e-551e-4718-be97-b2f2b21019ef admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:28.345055 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b158e-551e-4718-be97-b2f2b21019ef admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:28.349686 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5aeb4-6724-41a2-b584-cc9aa9e08f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:28.350326 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5aeb4-6724-41a2-b584-cc9aa9e08f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:28.350609 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5aeb4-6724-41a2-b584-cc9aa9e08f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:28.350883 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5aeb4-6724-41a2-b584-cc9aa9e08f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:28.351611 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5aeb4-6724-41a2-b584-cc9aa9e08f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:28.353296 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df5aeb4-6724-41a2-b584-cc9aa9e08f67 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:28.365113 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1426/2880] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:53:28.369858 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a76d8-8bb9-485a-9a9a-2eb741d850a8 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:28.384863 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a76d8-8bb9-485a-9a9a-2eb741d850a8 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:28.393636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb10e60-b1ae-4208-a862-ae9c4944c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:28.394812 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb10e60-b1ae-4208-a862-ae9c4944c78d admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:28.395178 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb10e60-b1ae-4208-a862-ae9c4944c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:28.395567 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb10e60-b1ae-4208-a862-ae9c4944c78d admin admin] PATH_INFO: `/v3/projects/dcfa358a60ec4387b490fc8a09e8e86c/users/cbe29fb624174561bff654091d3d3e2b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:28.412934 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb10e60-b1ae-4208-a862-ae9c4944c78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfa358a60ec4387b490fc8a09e8e86c, user_id=cbe29fb624174561bff654091d3d3e2b, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:28.415677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb10e60-b1ae-4208-a862-ae9c4944c78d admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:28.431401 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1455/2881] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:53:28 2022] PUT /identity/v3/projects/dcfa358a60ec4387b490fc8a09e8e86c/users/cbe29fb624174561bff654091d3d3e2b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:53:28.435468 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5aeb4-6724-41a2-b584-cc9aa9e08f67 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:28.446328 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5aeb4-6724-41a2-b584-cc9aa9e08f67 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:28.498075 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:28.513133 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0105867-8ad6-41bb-9905-f0cd8e99736b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:28.513808 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0105867-8ad6-41bb-9905-f0cd8e99736b admin admin] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:28.514120 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0105867-8ad6-41bb-9905-f0cd8e99736b admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:28.514395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0105867-8ad6-41bb-9905-f0cd8e99736b admin admin] PATH_INFO: `/v3/roles` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:28.515125 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0105867-8ad6-41bb-9905-f0cd8e99736b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:28.516738 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0105867-8ad6-41bb-9905-f0cd8e99736b admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:28.526768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1427/2882] 10.222.0.61 () {58 vars in 1121 bytes} [Fri Jul 1 19:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 19:53:28.531065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb10e60-b1ae-4208-a862-ae9c4944c78d admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:28.541807 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb10e60-b1ae-4208-a862-ae9c4944c78d admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:28.547272 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:28.548164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] REQUEST_METHOD: `PUT` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:28.548443 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:28.548715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] PATH_INFO: `/v3/projects/dcfa358a60ec4387b490fc8a09e8e86c/users/cbe29fb624174561bff654091d3d3e2b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:28.550872 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfa358a60ec4387b490fc8a09e8e86c, user_id=cbe29fb624174561bff654091d3d3e2b, role_id=4ab4ae14b1cd4c70b6c22f8dc3f0a441)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:28.553560 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:28.565080 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1456/2883] 10.222.0.61 () {60 vars in 1482 bytes} [Fri Jul 1 19:53:28 2022] PUT /identity/v3/projects/dcfa358a60ec4387b490fc8a09e8e86c/users/cbe29fb624174561bff654091d3d3e2b/roles/4ab4ae14b1cd4c70b6c22f8dc3f0a441 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 19:53:32.825853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072870c-d3fb-4190-b27c-571fb659d1aa None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:32.826939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072870c-d3fb-4190-b27c-571fb659d1aa None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:32.826939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072870c-d3fb-4190-b27c-571fb659d1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:32.868046 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-2072870c-d3fb-4190-b27c-571fb659d1aa None None] MFA Rules not processed for user `cbe29fb624174561bff654091d3d3e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:53:32.869527 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-2072870c-d3fb-4190-b27c-571fb659d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:32.978165 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1428/2884] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:53:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:53:32.995726 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:32.998579 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:33.083994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627637-f54d-4f56-bcbe-0805e663b639 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:33.090083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:33.090840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:33.091184 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:33.091518 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:33.166399 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:33.168151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:33.179830 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1457/2885] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:53:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:53:42.974024 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=42 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:43.174473 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:58.049083 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2cdc0-14b4-4e0b-89c4-5b1d650d1353 None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:58.049654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2cdc0-14b4-4e0b-89c4-5b1d650d1353 None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:58.049654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2cdc0-14b4-4e0b-89c4-5b1d650d1353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:58.068696 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-9bb2cdc0-14b4-4e0b-89c4-5b1d650d1353 None None] MFA Rules not processed for user `5a38bc1705a64785aaac2b561159fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:53:58.069919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-9bb2cdc0-14b4-4e0b-89c4-5b1d650d1353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:58.077407 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1429/2886] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:53:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:53:58.115891 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:58.117648 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:58.184760 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f53752-26ab-4513-b722-43b0e4fca282 service nova] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:58.188946 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:58.189596 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:58.189880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:58.190188 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:58.191998 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:58.205884 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:58.207360 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:58.220165 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1458/2887] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:53:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:53:58.525366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2cdc0-14b4-4e0b-89c4-5b1d650d1353 None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:58.586456 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2cdc0-14b4-4e0b-89c4-5b1d650d1353 None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:58.590912 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:58.591561 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:58.591844 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:58.592122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:58.594186 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:58.604358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:58.605795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:58.614044 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1430/2888] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:53:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:53:59.374295 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:53:59.384181 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b490d0-0b8d-4a03-a3ff-73fee561bb38 service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:53:59.388283 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:53:59.388927 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:53:59.389206 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:53:59.389479 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:53:59.391573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:53:59.406005 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:53:59.407452 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:53:59.418920 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1459/2889] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:53:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:54:08.610636 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=29 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:09.413712 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=32 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:15.033349 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:54:15.034980 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:54:15.050414 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f39bb-5dc0-477e-8089-7f0238a7947b service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:54:15.054428 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:54:15.055084 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:54:15.055366 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:54:15.055630 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:54:15.065911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:54:15.067419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:54:15.077136 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1431/2890] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:54:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:54:25.072756 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:36.516229 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:54:36.525689 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecc1e5-f849-4b5d-80c3-3308633badc4 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:54:36.530320 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f98338-0ef2-4132-b68e-8ea1a8a455df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:54:36.530956 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f98338-0ef2-4132-b68e-8ea1a8a455df service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:54:36.531240 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f98338-0ef2-4132-b68e-8ea1a8a455df service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:54:36.531528 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f98338-0ef2-4132-b68e-8ea1a8a455df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:54:36.533573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c6f98338-0ef2-4132-b68e-8ea1a8a455df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:54:36.543581 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f98338-0ef2-4132-b68e-8ea1a8a455df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:54:36.545015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f98338-0ef2-4132-b68e-8ea1a8a455df service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:54:36.553345 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1460/2891] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:54:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:54:46.549791 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=6 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:44.614184 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:55:44.615651 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:44.643666 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9c5c8-9be5-4cfc-82d3-be113171a8e8 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:55:44.651287 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:55:44.651966 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:55:44.652394 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:55:44.652780 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:55:44.654688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:44.668025 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:55:44.669716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:55:44.693344 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1432/2892] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:55:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:55:52.081317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be489d8-a46a-44ef-ab19-75f14847aaa4 None None] REQUEST_METHOD: `POST` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:55:52.081817 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be489d8-a46a-44ef-ab19-75f14847aaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:55:52.081937 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be489d8-a46a-44ef-ab19-75f14847aaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:55:52.100149 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.auth.core [None req-1be489d8-a46a-44ef-ab19-75f14847aaa4 None None] MFA Rules not processed for user `bd7b6bcd191f45d39f6c5e5a6bf7646a`. Rule list: `[]` (Enabled: `True`). {{(pid=80243) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:55:52.101352 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1be489d8-a46a-44ef-ab19-75f14847aaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:52.166924 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1461/2893] 10.222.0.61 () {58 vars in 967 bytes} [Fri Jul 1 19:55:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:55:52.207312 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:55:52.209228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:52.280299 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d596d5-2ef3-4d0a-b3ed-35ce58ca663f service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:55:52.285659 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6de49ef308324229b81a8fa6f3f84287', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:55:52.286324 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:55:52.286603 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:55:52.286875 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:55:52.295920 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:55:52.297534 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:55:52.306228 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1433/2894] 10.222.0.61 () {60 vars in 1384 bytes} [Fri Jul 1 19:55:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 19:55:55.497317 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be489d8-a46a-44ef-ab19-75f14847aaa4 None None] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:55:55.499113 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-1be489d8-a46a-44ef-ab19-75f14847aaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:55.609803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be489d8-a46a-44ef-ab19-75f14847aaa4 None None] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:55:55.614706 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:55:55.615397 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:55:55.615683 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:55:55.615962 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:55:55.617798 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:55.630330 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:55:55.631939 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:55:55.645803 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1462/2895] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:55:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:55:58.784227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:55:58.785681 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:58.855644 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f57fd-5c2e-4dde-9ffd-207cfb001448 service swift] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:55:58.860192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:55:58.861078 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:55:58.861360 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:55:58.861633 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] PATH_INFO: `/v3/users/5524d84deeb747038a220e64b3c9bf34` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:55:58.862853 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5524d84deeb747038a220e64b3c9bf34)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:55:58.864861 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:55:58.911678 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5524d84deeb747038a220e64b3c9bf34'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:58.912346 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5524d84deeb747038a220e64b3c9bf34'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:58.921682 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5524d84deeb747038a220e64b3c9bf34'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:58.929008 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5524d84deeb747038a220e64b3c9bf34'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:58.940164 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:58.941410 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5524d84deeb747038a220e64b3c9bf34'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:58.948416 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1434/2896] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:55:58 2022] DELETE /identity/v3/users/5524d84deeb747038a220e64b3c9bf34 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:55:59.132154 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:55:59.144476 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ef6f6-7f4c-4bf2-ad4b-f970b55ee6fe service placement] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:55:59.203890 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:55:59.204688 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:55:59.204973 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:55:59.205254 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] PATH_INFO: `/v3/projects/b0cea6fd9c8b465a862b8cf334a4335c` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:55:59.206505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cea6fd9c8b465a862b8cf334a4335c)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:55:59.208472 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:55:59.257156 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:59.266591 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cea6fd9c8b465a862b8cf334a4335c', 'request_id': 'req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.275396 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cea6fd9c8b465a862b8cf334a4335c', 'request_id': 'req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.280882 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cea6fd9c8b465a862b8cf334a4335c', 'request_id': 'req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.291713 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] The token cache is being invalidate because project b0cea6fd9c8b465a862b8cf334a4335c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:55:59.292001 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.292661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.294307 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1463/2897] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:55:59 2022] DELETE /identity/v3/projects/b0cea6fd9c8b465a862b8cf334a4335c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:55:59.298472 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:55:59.299886 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:59.315005 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fc83a-2c73-4500-8419-71df1b696114 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:55:59.385876 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:55:59.386821 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:55:59.387102 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:55:59.387368 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] PATH_INFO: `/v3/users/1a4135feed754dca93f84ec9630be3cf` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:55:59.388585 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4135feed754dca93f84ec9630be3cf)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:55:59.390569 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:55:59.442139 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4135feed754dca93f84ec9630be3cf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.442791 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4135feed754dca93f84ec9630be3cf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.451347 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4135feed754dca93f84ec9630be3cf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.459418 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4135feed754dca93f84ec9630be3cf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.478622 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3da515a5-6bef-445f-94bd-b3b682610c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4135feed754dca93f84ec9630be3cf'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.485174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1435/2898] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 19:55:59 2022] DELETE /identity/v3/users/1a4135feed754dca93f84ec9630be3cf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:55:59.659658 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:55:59.661258 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:55:59.675081 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35479-6b1a-4dd2-898d-bc0662e4b6fe admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:55:59.733044 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:55:59.733878 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:55:59.734246 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:55:59.734522 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] PATH_INFO: `/v3/projects/ff54ec15f2884c5cab352a9a16f54f17` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:55:59.735759 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff54ec15f2884c5cab352a9a16f54f17)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:55:59.737682 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:55:59.792428 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff54ec15f2884c5cab352a9a16f54f17', 'request_id': 'req-a9c22348-ce39-4606-8ab5-644d52cdad77'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.802031 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff54ec15f2884c5cab352a9a16f54f17', 'request_id': 'req-a9c22348-ce39-4606-8ab5-644d52cdad77'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.807840 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff54ec15f2884c5cab352a9a16f54f17', 'request_id': 'req-a9c22348-ce39-4606-8ab5-644d52cdad77'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.819412 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] The token cache is being invalidate because project ff54ec15f2884c5cab352a9a16f54f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80243) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 19:55:59.819699 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.820389 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 19:55:59.822063 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1464/2899] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 19:55:59 2022] DELETE /identity/v3/projects/ff54ec15f2884c5cab352a9a16f54f17 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 19:56:09.481419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:09.816690 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:48.579721 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c09f7-b76c-47de-8470-ad0cd746151f None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:56:48.580267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c09f7-b76c-47de-8470-ad0cd746151f None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:56:48.580267 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c09f7-b76c-47de-8470-ad0cd746151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:56:48.598227 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-da0c09f7-b76c-47de-8470-ad0cd746151f None None] MFA Rules not processed for user `5a38bc1705a64785aaac2b561159fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:56:48.599426 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-da0c09f7-b76c-47de-8470-ad0cd746151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:56:48.677027 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1436/2900] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:56:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:56:49.503347 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:56:49.504898 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:56:49.576574 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22348-ce39-4606-8ab5-644d52cdad77 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:56:49.581700 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:56:49.582387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:56:49.582715 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:56:49.582931 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:56:49.584778 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:56:49.596449 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:56:49.598073 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:56:49.608312 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1465/2901] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:56:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:56:58.670174 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=25 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:59.604146 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=32 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:40.822192 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c09f7-b76c-47de-8470-ad0cd746151f None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:57:40.835958 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c09f7-b76c-47de-8470-ad0cd746151f None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:57:40.842715 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94000aa3-6861-43f2-8f2c-30de9b0adc8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:57:40.843365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000aa3-6861-43f2-8f2c-30de9b0adc8c service placement] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:57:40.843654 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000aa3-6861-43f2-8f2c-30de9b0adc8c service placement] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:57:40.843928 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94000aa3-6861-43f2-8f2c-30de9b0adc8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:57:40.845977 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-94000aa3-6861-43f2-8f2c-30de9b0adc8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:57:40.858149 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000aa3-6861-43f2-8f2c-30de9b0adc8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:57:40.859745 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94000aa3-6861-43f2-8f2c-30de9b0adc8c service placement] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:57:40.869872 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1437/2902] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:57:50.865830 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=6 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:07.661679 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:59:07.663357 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:07.721911 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27663cc4-f552-46b9-9ef6-cf1b4e0e5c60 service placement] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:59:07.725968 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:59:07.726613 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:07.726892 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:07.727228 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:07.729277 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:07.740499 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:59:07.742082 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:59:07.751083 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1466/2903] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:59:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:59:17.746929 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=26 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:20.985939 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04372dc-f356-487e-b63d-cbedd508005b None None] REQUEST_METHOD: `POST` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:20.986577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04372dc-f356-487e-b63d-cbedd508005b None None] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:20.986577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04372dc-f356-487e-b63d-cbedd508005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:21.007716 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.auth.core [None req-d04372dc-f356-487e-b63d-cbedd508005b None None] MFA Rules not processed for user `5a38bc1705a64785aaac2b561159fa26`. Rule list: `[]` (Enabled: `True`). {{(pid=80244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 19:59:21.008919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d04372dc-f356-487e-b63d-cbedd508005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:21.017358 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1438/2904] 10.222.0.61 () {58 vars in 957 bytes} [Fri Jul 1 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 19:59:21.065505 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:59:21.074485 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74c22f-eab9-4981-ac1b-df49e9e7f1fb service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:59:21.078497 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfbcf52f970e475c8d7f91d373949ce6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:59:21.079135 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:21.079425 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:21.079693 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:21.081645 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:21.155544 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:59:21.157023 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:59:21.168349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1467/2905] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:59:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:59:21.480810 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04372dc-f356-487e-b63d-cbedd508005b None None] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:59:21.482434 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d04372dc-f356-487e-b63d-cbedd508005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:21.540311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04372dc-f356-487e-b63d-cbedd508005b None None] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:59:21.544278 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:59:21.544911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:21.545185 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:21.545457 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:21.547300 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:21.557094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:59:21.558911 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:59:21.567101 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1439/2906] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:59:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:59:22.039039 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:59:22.049636 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe67913-d535-4ce3-807e-1e0b3910fa2f service cinder] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:59:22.054271 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:59:22.054923 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:22.055238 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:22.055728 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:22.059374 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:22.080159 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:59:22.081640 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:59:22.094321 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1468/2907] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:59:31.563782 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=29 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:32.093435 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=40 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:36.396392 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:59:36.397979 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:36.418383 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49982f39-25e5-4b56-8bbc-e7a374d18b2f service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:59:36.424230 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:59:36.425031 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:36.425365 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:36.426240 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:36.429094 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:36.443731 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:59:36.445649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:59:36.457888 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1440/2908] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:59:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 19:59:36.743041 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:59:36.753015 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd290d8f-003b-4cb6-b9ad-2deea97cef47 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:59:36.759677 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:59:36.760670 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:36.760954 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:36.761251 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:36.763573 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:36.775349 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:59:36.776804 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:59:36.788164 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1469/2909] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:59:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:59:38.957753 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:59:38.959264 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:38.970789 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbbb84-42ec-4968-905a-391a66fe8ecc service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:59:38.974610 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:59:38.975244 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:38.975525 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:38.975795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:38.977564 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:39.045413 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:59:39.046919 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:59:39.058677 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1441/2910] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:59:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:59:40.922116 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 19:59:40.936604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98730e8-732e-4eb5-be7d-2058ed75d477 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 19:59:40.943276 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 19:59:40.944193 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 19:59:40.944477 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 19:59:40.944763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 19:59:40.946661 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 19:59:40.959624 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 19:59:40.961342 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 19:59:40.972894 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1470/2911] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 19:59:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 19:59:49.053053 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=36 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:50.968185 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=12 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:50.115799 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 20:01:50.188486 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d634700e-bd8f-4ba6-b902-711e226e6d18 service neutron] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 20:01:50.194764 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd78ccd9541dc48cfbdfc116dcec91a2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 20:01:50.195408 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 20:01:50.195688 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 20:01:50.195957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 20:01:50.197804 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:01:50.236395 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 20:01:50.238062 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 20:01:50.249382 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1442/2912] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 20:01:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 20:01:53.261538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 20:01:53.300370 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8f79d-6530-4c99-adf0-4997638a8f81 service nova] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 20:01:53.304992 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fcc425392664c17b72fb4655f8fb7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 20:01:53.305763 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 20:01:53.306070 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 20:01:53.306684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 20:01:53.308874 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:01:53.397218 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 20:01:53.398709 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 20:01:53.420151 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1471/2913] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 20:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 20:01:56.568741 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 20:01:56.570517 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:01:56.591311 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ca360-09a6-4345-b7bb-ddaff05948b5 service nova] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 20:01:56.597649 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 20:01:56.598333 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] REQUEST_METHOD: `GET` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 20:01:56.598617 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 20:01:56.598894 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 20:01:56.600768 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:01:56.612957 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 20:01:56.614577 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 20:01:56.627747 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1443/2914] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 20:01:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 20:01:59.909445 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 20:01:59.912140 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:01:59.924820 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f743d-15b3-4b9d-b0d3-575e129bc035 service neutron] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 20:01:59.929607 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 20:01:59.930570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 20:01:59.930857 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 20:01:59.931141 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] PATH_INFO: `/v3/users/5a38bc1705a64785aaac2b561159fa26` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 20:01:59.932676 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a38bc1705a64785aaac2b561159fa26)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 20:01:59.934684 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 20:01:59.989673 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a38bc1705a64785aaac2b561159fa26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.000568 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a38bc1705a64785aaac2b561159fa26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.001204 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a38bc1705a64785aaac2b561159fa26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.009334 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a38bc1705a64785aaac2b561159fa26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.027534 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a38bc1705a64785aaac2b561159fa26'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.033652 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1472/2915] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 20:01:59 2022] DELETE /identity/v3/users/5a38bc1705a64785aaac2b561159fa26 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 20:02:00.220829 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 20:02:00.231722 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316215-e03a-412c-9279-0f82d0af517d service placement] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 20:02:00.289167 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 20:02:00.290122 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 20:02:00.290419 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 20:02:00.290687 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] PATH_INFO: `/v3/projects/dd20b488413a476aa45ee9c6d3ffbf70` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 20:02:00.291851 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd20b488413a476aa45ee9c6d3ffbf70)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 20:02:00.293762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 20:02:00.342953 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd20b488413a476aa45ee9c6d3ffbf70', 'request_id': 'req-3460c748-9aee-48e5-882f-fc2deda34899'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.354558 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd20b488413a476aa45ee9c6d3ffbf70', 'request_id': 'req-3460c748-9aee-48e5-882f-fc2deda34899'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.359520 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:00.360820 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd20b488413a476aa45ee9c6d3ffbf70', 'request_id': 'req-3460c748-9aee-48e5-882f-fc2deda34899'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.373964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] The token cache is being invalidate because project dd20b488413a476aa45ee9c6d3ffbf70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 20:02:00.374266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.375057 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.376762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1444/2916] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 20:02:00 2022] DELETE /identity/v3/projects/dd20b488413a476aa45ee9c6d3ffbf70 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 20:02:00.380965 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 20:02:00.382570 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:02:00.396368 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb04610-a2fc-4b1d-8799-562708e9ae80 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 20:02:00.404880 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:00.457864 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 20:02:00.459427 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 20:02:00.459716 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 20:02:00.459994 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] PATH_INFO: `/v3/users/cbe29fb624174561bff654091d3d3e2b` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 20:02:00.461311 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe29fb624174561bff654091d3d3e2b)` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 20:02:00.463316 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 20:02:00.513538 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe29fb624174561bff654091d3d3e2b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.521604 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe29fb624174561bff654091d3d3e2b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.522282 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe29fb624174561bff654091d3d3e2b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.529387 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe29fb624174561bff654091d3d3e2b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.541384 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.notifications [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe29fb624174561bff654091d3d3e2b'} {{(pid=80243) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.547391 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1473/2917] 10.222.0.61 () {58 vars in 1223 bytes} [Fri Jul 1 20:02:00 2022] DELETE /identity/v3/users/cbe29fb624174561bff654091d3d3e2b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 20:02:00.728379 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] Authenticating user token {{(pid=80244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 20:02:00.730166 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.fernet_utils [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:02:00.748443 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460c748-9aee-48e5-882f-fc2deda34899 admin admin] Validating token access rules against request {{(pid=80244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 20:02:00.809195 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b9038df7e244837aceca33ded6cf0a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c274d3083ff496a9f0346d090423253', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 20:02:00.810013 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 20:02:00.810309 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 20:02:00.810593 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] PATH_INFO: `/v3/projects/dcfa358a60ec4387b490fc8a09e8e86c` {{(pid=80244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 20:02:00.811795 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfa358a60ec4387b490fc8a09e8e86c)` {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 20:02:00.813762 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] RBAC: Authorization granted {{(pid=80244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 20:02:00.863669 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfa358a60ec4387b490fc8a09e8e86c', 'request_id': 'req-b8714900-4e8c-466f-81f6-32f33e01cb91'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.872798 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfa358a60ec4387b490fc8a09e8e86c', 'request_id': 'req-b8714900-4e8c-466f-81f6-32f33e01cb91'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.878499 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfa358a60ec4387b490fc8a09e8e86c', 'request_id': 'req-b8714900-4e8c-466f-81f6-32f33e01cb91'} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.889968 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] The token cache is being invalidate because project dcfa358a60ec4387b490fc8a09e8e86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 20:02:00.890266 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.890964 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG keystone.notifications [None req-b8714900-4e8c-466f-81f6-32f33e01cb91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 20:02:00.892618 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: [pid: 80244|app: 0|req: 1445/2918] 10.222.0.61 () {58 vars in 1232 bytes} [Fri Jul 1 20:02:00 2022] DELETE /identity/v3/projects/dcfa358a60ec4387b490fc8a09e8e86c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 20:02:10.544058 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:10.886940 dv-cinder-831247-20-iscsi devstack@keystone.service[80244]: DEBUG dbcounter [-] [80244] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:49.722976 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] Authenticating user token {{(pid=80243) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 20:02:49.724971 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:02:49.821913 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f80fb7-4cb6-43e6-a9c9-fdf168c40988 admin admin] Validating token access rules against request {{(pid=80243) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 20:02:49.886865 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0ba61-4910-4c1f-a101-8b4494cdc710 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f6684cfbbc54d568730d44c923770ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c4357b276a7478bac1f9e6086fd8ceb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80243) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 20:02:49.887509 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ba61-4910-4c1f-a101-8b4494cdc710 service placement] REQUEST_METHOD: `GET` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 20:02:49.887792 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ba61-4910-4c1f-a101-8b4494cdc710 service placement] SCRIPT_NAME: `/identity` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 20:02:49.888065 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ba61-4910-4c1f-a101-8b4494cdc710 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80243) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 20:02:49.890104 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.fernet_utils [None req-47c0ba61-4910-4c1f-a101-8b4494cdc710 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80243) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 20:02:49.901548 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0ba61-4910-4c1f-a101-8b4494cdc710 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 20:02:49.903160 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0ba61-4910-4c1f-a101-8b4494cdc710 service placement] RBAC: Authorization granted {{(pid=80243) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 20:02:49.913179 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: [pid: 80243|app: 0|req: 1474/2919] 10.222.0.61 () {60 vars in 1365 bytes} [Fri Jul 1 20:02:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 20:02:59.909092 dv-cinder-831247-20-iscsi devstack@keystone.service[80243]: DEBUG dbcounter [-] [80243] Writing DB stats keystone:SELECT=67 {{(pid=80243) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}